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The  purpose  of  this  study  was  to  examine  the  effects 
of  verbal  and  perceptual  aspects  of  learner  aptitude,  in 
relation  to  inspection  behaviors  performed  while  learning 
from  written  materials  containing  two  modes  of  instruction- 
al content.  Science  instructional  materials  containing 
both  text  and  diagrams  were  modified  by  inserting  questions 
that  asked  for  information  either  from  the  text  or  from  the 
diagrams,  or  no  questions.   In  addition,  highlighting 
(Subjects  marked  "important  information"  with  a  yellow  felt- 
tip  marker)  provided  an  additional  treatment  condition.   It 
was  expected  that  these  variations  in  treatment  conditions 
would  influence  the  acquisition  of  both  relevant  and  in- 
cidental information  from  diagrams  and  texts.   Furthermore, 
it  was  anticipated  that  learner  performance  would  exhibit 
differential  response  to  the  treatment  conditions. 


One  hundred  eighty  five  subjects  were  randomly 
assigned  to  one  of  six  treatment  groups  In  a  3  (types  of 
Inserted  questions)  by  2  (highlighting  or  no  highlighting) 
factorial  design.   Subjects  were  given  aptitude  tests 
representing  verbal  and  perceptual  abilities  in  addition 
to  treatment  materials  and  post-test  criterion  measures. 
Post-test  measures  included  performance  on  relevant 
diagram  questions.  Incidental  diagram  questions,  relevant 
text  questions,  incidental  text  questions.   The  percentage 
of  information  highlighted  in  the  text  and  diagrams  was 
also  recorded. 

Comparison  of  performances  on  relevant  text  or 
diagram  questions  by  pairs  of  treatment  conditions  following 
an  overall  significant  F  ratio  disclosed  that  inserted 
questions  facilitated  the  acquisition  of  relevant  informa- 
tion while  exerting  little  Influence  upon  the  acquisition 
of  incidental  information.   A  repeated  measures  analysis 
using  the  amount  of  information  highlighted  as  the  repeated 
measure  across  written  passages  revealed  that  the  change  in 
the  percent  of  information  highlighted  from  the  base  rate 
for  passage  one  significantly  Increased  for  diagrammatic 
information,  but  decreased  significantly  for  texts.   Rela- 
tionships between  aptitude  to  criterion  scores  were 
interpreted  following  significant  F  tests  for  heterogeneity 
of  regression,  indicating  significant  intersections  of 
regression  lines  for  alternative  treatments.   Results  of 
these  analysis  disclosed  positive  relationships  between 
xi 


the  number  of  inserted  questions  answered  and  the  performance 
on  relevant  post-test  questions.  Aptitude  x  treatment  inter- 
actions were  found  between  associative  memory  ability  and 
performance  on  relevant  text  information,  and  also  the  time 
spent  in  the  treatment  and  the  performance  on  relevant  and 
incidental  post-test  questions. 
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CHAPTER  I 
THE  PROBLEM 
Definition  of  the  Problem 
The  purpose  of  this  study  was  to  examine  the  effects 
of  verbal  and  perceptual  aspects  of  learner  aptitude,  in 
relation  to  inspection  behaviors  performed  while  learning 
from  written  materials  contai-niTig  two  modes  of  instruc- 
tional content. 

Background  to  the  Problem 

■  •♦ 

Written  materials  are  convenient,  easily  managed, 
instructional  stimuli.   They  are  credited  with  the  capa- 
bility of  directing  learners  toward  predetermined  outcomes 
by  their  potential  to  influence  the  activity  of  the 
learner.  One  way  materials  influence  learning  is  to 
present  selected  information  in  a  fashion  believed  to  be 
compatible  with  acquisition.   However,  what  specific 
variations  facilitate  acquisition  and  how  they  should  be 
built  into  written  materials  in  order  to  maximize  learning 
activities  remains  to  be  empirically  determined. 

Several  plausible  approaches  for  arranging  written 
instructional  stimuli  are  currently  being  explored.   One 
approach  presents  information  in  a  progression  from  one 
level  of  prerequisite  knowledge  and  skills  to  other  more 
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complex  levels,  when  instructional  sequences  were,  for 
instance,  based  upon  hypothetical  mathematical  content 
structures,  they  were  found  to  be  effective  for  the  acqui- 
sition of  mathematics  (Gagne  and  Paradise,  1961).  This 
approach  to  learning  depends  on  a  cumulative  learning 
sequence.  Another  approach  segments  the  instructional 
stimuli  into  short  periods  with  frequent  repetition  of 
information  and  practice  activity  as,  for  example,  in 
programmed  instruction.   Here,  repeated  exposure  is 
credited  as  a  means  of  increasing  the  likelihood  that  the 
highly  redundant  information  will  be  acquired. 

Neither  information  hierarchies  nor  presentation- 
practice  sequences  can  be  considered  as  a  generally 
suitable  approach  for  all  learners  or  content.  Hierar- 
chies, for  example,  are  limited  to  the  subject  area  of 
the  hierarchy.   In  addition,  hierarchial  sequences  assume 
that  psychological  activities  associated  with  acquisition 
and  performance  on  one  level  will  be  transferred  and 
performed  on  subsequent  levels.  Presentation,  repetition, 
and  practice  strategies  attempt  to  control  acquisition  and 
performance  by  dividing  practice  and  other  aspects  of  the 
learning  activity  into  relatively  small  discrete  events. 
The  capability  to  generalize  this  approach  to  a  wide  range 
of  learners  and  conditions  remains  in  question  in  view  of 
research  which  supports  the  notion  that  not  all  instruction- 
al content  can  be  subdivided  into  short  segments  with 
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sub-eventB  and  trials  as  means  to  facilitate  acquisition 
for  all  types  of  learners  (Woodworth,  1938,  pp.  19-20). 
Many  approaches  to  instruction  have  focused  only 
upon  the  relationships  between  presented  stimuli  and 
observable  performances,  neglecting  the  many  possible 
ways  in  which  internal  response  processes  work  in  relation 
to  various  stimuli  and  overt  response  variables.  The 
fact  that  short  segments  may  limit  the  range  of  these 
internal  learner  responses  supports  the  objective  of 
controlling  the  variance  of  acquisition  among  learners, 
but  it  also  illuminates  why  more  complex  learning  tasks, 
which  are  considered  to  be  dependent  upon  a  wider  range 
of  internal  processes,  are  perhaps  not  suitable  as 
content  for  highly  segmented  or  hierarchial  instruction. 
The  possibility  has  received  little  consideration  that 
the  internal  responses  learners  perform  during  instruction 
may  be  both  educationally  desirable  and  manageable.   In 
addition,  tactics  for  managing  these  activities  may  be 
generalizal>le  across  content  tasks. 

Ausubel  (1968)  has  suggested  that  meaningful  learning 
occurs  when  internal  processes  of  the  learner  associates 
new  information  with  subsuming  concepts  already  in  their 
cognitive  structure.   Written  materials  would  promote 
effective  processing  by  presenting  content  in  "meaningful 
contexts."  When  suitable  subsuming  concepts  do  not 
already  exist  in  the  learner's  cognitive  structure,  the 
concept  can  be  presented  in  advance  of  the  new  information. 
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Ausubel  calls  concepts  when  presented  in  this  manner, 
"advance  organizers."  Their  effectiveness  has  been 
empirically  demonstrated  (Ausubel  and  Fitzgerald,  1962; 
Koran,  J.  J.  and  Koran,  M.  L. ,  In  Press). 

Learning  activity  can  also  be  directed  by  placing 
cues  and  prompts,  such  as  questions,  directions,  dia- 
grams, examples,  within  the  written  material.  These 
direct  the  learner  into  the  vicinity  of  the  instructional 
objective  (Hall,  Lund,  and  Jackson,  1968),  guide  the 
selecting  and  processing  of  appropriate  instructional 
objectives  (Walker  and  Buckley,  1968),  and  shape  the 
selection  and  processing  of  appropriate  stimulus  compo- 
nents (Bruning,  1968;  Rothkopf,  1966;  Frase,  1969).   All 
these  activities  are  classified  as  mathemagenic  activities 
(Rothkopf,  1963).  While  some  are  considered  to  be  gross 
motor  in  nature,  such  as  manipulating  objects,  and  there- 
fore are  observable  and  easy  to  measure,  others  include 
such  covert  inspection  and  processing  activities  as 
scanning,  translating,  formulating  mental  associations, 
discriminating,  focusing,  elaborating,  and  categorizing. 
The  potential  for  instructional  flexibility  derived  from 
the  manipulation  of  mathemagenic  activity  underscores  the 
need  for  their  careful  study. 

It  is  the  intent  of  this  study  to  examine  certain 
effects  associated  with  inspection  behavior,  a  subset  of 
mathemagenic  activity. 
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Related  Theory  and  Research 
Definition  of  Mathemagenlc  Activity 

The  concept  of  mathemagenlc  behavior  focuses  upon 
the  observable  and  hypothetical  activity  learners  perform 
when  confronted  with  Instructional  stimuli.  The  term, 
mathemagenlc  was  derived  by  Rothkopf  from  the  two  Greek 
roots  mathema,  which  means  "that  which  is  learned"  and 
glgnesthai ,  which  means  "to  be  born."  Therefore, 
mathemagenlc  behaviors  are  activities  which  give  birth 
to  learning  (Rothkopf,  1965). 

In  describing  how  humans  learn  from  written  materials, 
a  distinction  can  be  made  between  the  physical  stimulus 
presented  to  the  learner  and  the  effective  stimulus  encoded 
by  various  internal  processing  activities  performed  by  the 
learner  (Rothkopf,  1970).   This  distinction  simply  implies 
that  the  physical  stimulus  is  not  in  simple  correspondence 
to  the  stimulus  that  has  an  effect  upon  psychological 
learning  activity.  The  wide  gap  that  probably  exists 
between  these  stimuli  may  be  the  result  of  differential 
orientation  of  attention,  structural  variations  of  the 
sensory  receptor  surfaces,  or  even  extent  to  which  the 
learner  transforms  or  elaborates  the  physical  stimulus. 
However,  since  these  effective  stimuli  become  the  basis 
for  all  subsequent  psychological  learning  activity,  their 
character  determines  what  is  learned  (Rothkopf,  1970). 


When  learning  from  written  materials,  the  learner 
must  perform  a  prolonged  and  skilled  activity,  namely 
reading,  if  the  desired  instructional  outcomes  are  to  be 
achieved.  Reading  includes  many  mathemagenic  activities 
both  observable  or  hypothetical  in  nature.  Observable 
activities  may  include  orienting  activities  which  direct 
learners  into  the  vicinity  of  instructional  objects  and 
keep  them  there  for  suitable  time  periods;  other  activities 
serve  to  select  and  procure  appropriate  instructional 
objects  once  in  the  vicinity  (Rothkopf,  1970).  Hypothet- 
ical activities  may  also  be  performed  and  are,  in  general, 
of  greater  interest  to  research  in  view  of  their  potential 
to  facilitate  learning. 

One  group  of  hypothetical  mathemagenic  behaviors  is 
called  translation  and  refers  to  activities  where  learners 
scan  the  written  page  and  translate  the  alphabetic  display 
into  the  sound  of  words  or  their  subvocal  surrogates.  This 
process  is  considered  preliminary  to  encoding  selected 
bits  of  these  alphabetic  displays  as  elements  of  effective 
stimuli.  Translation  in  itself  is  not  enough,  as  verified 
when  learners  encounter  difficult  and  boring  written 
materials.  Here  translation  may  deteriorate  into  dis- 
orientation, an  observable  mathemagenic  activity  leading 
away  from  the  instructional  goal. 

Another  hypothetical  behavior,  often  referred  to  as 
segmentation,  includes  learner  activities  that  break  the 
stimulus  string  into  syntactic  and  other  unit  components 


(Rothkopf,  1965).   Segmentation  generally  attempts  to 
account  for  the  formulation  of  meaningful  associative 
vinlts  within  sentences  as  well  as  the  more  complex  units 
associated  between  sentences. 

A  third  hypothetical  activity  called  processing, 
collectively  includes  a  variety  of  mental  activities 
learners  perform  with  information  such  as  reviewing, 
categorizing,  elaborating,  devising  mnemonic  associations, 
and  other  activities  process  information  (Rothkopf,  1968). 
These  activities  all  function  to  elaborate  ways  learners 
can  incorporate  prior  learnings  into  otherwise  unfamiliar 
written  stimuli.  They  may  potentially  account  for  some  of 
the  vast  variance  between  individual  performances  resulting 
from  exposure  to  identical  instructional  stimuli. 

While  these  categories  of  mathemagenic  activities  do 
not  exhaust  all  possibilities,  they  have  received  attention 
because  of  their  potential  for  research  as  well  as  their 
hypothesized  involvement  with  acquisition.  However, 
because  these  behaviors  are  mostly  Intervening  variables, 
they  require  indirect  measurement.  Consequently  when 
dealing  with  them,  assumptions  must  be  made  by  the 
research,  concluding  that  these  activities  are  persistent, 
topographical,  exhibit  rate  characteristics,  and  modifiable 
by  certain  environmental  events. 

In  order  for  mathemagenic  hypotheses  to  become 
functional,  ways  to  influence  learning  behaviors  must  be 
identified.   Since  these  behaviors  are  basically  sensitive 
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to  elements  within  the  physical  stimulus,  variations 
within  this  stimulus  can  be  incorporated  which  exert 
influence  upon  selected  mathemagenic  behavior.   In  this 
sense,  the  physical  stimulus  can  be  designed  to  include 
prompts  and  cues  that  shape  the  mathemagenic  behavior. 
The  success  of  their  influence  upon  specific  mathemagenic 
activity  follows  the  notion  that  the  behaviors  can  be 
shaped.  However,  implicit  in  this  notion  is  that  the 
learner  responds  in  a  manner  guided  by  stimuli  and  re- 
inforced by  the  success  of  his  generating  suitable  responses. 
Certain  cuing  or  prompting  techniques  can  be  associated 
with  each  behavior  identified  above.   Segmentation  which  in- 
volves selecting  key  bits  of  associated  information,  may  be 
influenced  by  sentence  order  and  relational  wordage, 
including  verb  selection,  tense,  or  proximity  of  key  parts 
within  the  sentence  (Anderson,  1970).  Translation,  which 
involves  interpreting  a  stimulus  string  with  suitable 
Inflection,  may  l)e  influenced  by  exposing  learners  to 
audio  models  of  stimulus  strings  or  underlining  groups  of 
%«ords  that  receive  special  emphasis  by  inflection.   Process- 
ing activities  may  be  greatly  influenced  by  directions, 
test-like  events,  and  other  cues  which  direct  attention  or 
review  activity  toward  important  classes  of  information 
within  the  reading  activity. 

Controlling  mathemagenic  activity  means  to  exert  an 
influence  upon  the  formulation  of  the  effective  learning 
stimuli.   Potentially  these  stimuli  may  reflect  associations 


between  new  information  elaborated  by  prior  learnings. 
However,  they  may  or  may  not  be  consistent  with  the 
instructional  objective.  Therefore,  mathemagenic 
activities  are  considered  to  be  effective  when  they 
facilitate  acquisition  and  hence  the  attainment  of 
instructional  objectives. 

In  summary,  a  mathemagenic  hypothesis  recognizes  a 
difference  between  the  physical  stimuli  of  instructional 
material  and  the  effective  stimuli  learners  construct 
lor  themselves  using  various  covert  and  overt  behaviors. 
Instructional  materials  which  emphasize  sequenced  and 
segmented  bits  of  information  for  practice  and  acquisition 
generally  consider  the  physical  and  effective  stimulus  to 
be  the  same.  Furthermore,  the  act  of  segmenting  instruc- 
tion into  small  bits  may  well  encourage  deterioration  of 
several  essential  mathemagenic  activities.  Therefore, 
research  into  ways  to  shape  and  manipulate  the  mathemagenic 
activity  potentially  can  lead  to  flexible  use  of  instruc- 
tional materials  by  reducing  the  need  to  task  analyze  and 
restructure  all  written  materials.   In  addition,  mathema- 
genic activities  identify  many  variables  potentially 
useful  for  describing  individual  differences  between 
learners.  After  all,  adequate  description  is  an  important 
prerequisite  to  effective  prescription.  Finally,  mathema- 
genic approach  concentrates  on  maintaining  learner 
behaviors  that  produce  learning.   In  so  doing,  it  attempts 
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to  capitalize  on  the  adaptive,  error-correcting  charac- 
teristics of  human  learning  behavior  (Rothkopf,  1968). 

Research  on  the  Control  of 
Mathemagenic  Activity 

Interest  in  mathemagenic  activity  grew  out  of  the 
use  of  questions  within  frames  of  programmed  materials. 
Variations  in  question  placement,  frequency  of  questions, 
and  predictability  of  response  were  found  to  influence 
performance  in  terms  of  acquisition  and  retention  of 
information  (Rothkopf,  1963).  While  the  possibility 
exists  that  the  variable  use  of  questions  may  have  a 
direct  influence  upon  the  acquisition  of  content  ger  s£, 
differences  in  acquisition  indicate  that  questions  may 
also  influence  mathemagenic  activity  relative  to  the 
processing  of  the  instructional  material.  Perhaps 
variable  use  of  prompts  and  cues,  such  as  questions,  could 
be  selected  and  utilized  within  instructional  materials 
according  to  their  alleged  potential  to  influence  processing 
and  thereby  facilitate  acquisition,  rather  than  their  more 
common  utilization  based  upon  their  relationship  to  content 
structures.   Consequently,  studies  of  mathemagenic  activity 
and  factors  that  influence  them  may  ultimately  describe, 
from  a  generalizable  perspective,  ways  to  facilitate 

learning. 

Hypothetical  mathemagenic  activities  have  received 
experimental  attention  and  evidence  is  available  that  they 
are  modifiable  external  events.  Directions  are  one  type 
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of  event  which  seem  to  influence  these  activities. 
Generally,  research  with  directions  have  dealt  with 
either  directions  of  intent  or  manipulative  directions 
for  influencing  search  activity.  Postman  and  Sanders 
(1946),  for  example,  found  that  directions  to  learn 
specific  classes  from  text  material  may  influence  learning, 
but  their  findings  also  demonstrated  that  facilitation  was 
not  necessarily  in  keeping  with  the  intent  of  the  directions. 
Three  other  studies  (Bruning,  1968;  Rothkopf,  1966;  Tenenberg, 
1969)  indicated  that  vague  oratory  directions  of  intent  affect 
learner's  mathemagenic  activity  sufficiently  to  elevate  post 
reading  performance.  Specific  directions  to  find  certain 
items  of  information  in  a  test  can  also  influence  incidental 
learning,  in  addition  to  the  direct  acquisition  of  relevant 
items  (Frase,  1969). 

Evidence  concerning  the  influence  upon  acquisition 
and  retention  through  manipulation  of  the  written  passage 
Itself  Indicates  that  variations  in  sentence  order  and 
repetition  can  alter  inspection  behavior  associated  with 
reading.  When  reading  passages  provided  inunediate 
repetition  of  sentences  containing  key  attributive 
information,  poor  retention  and  acquisition  resulted  on 
post-tests  even  when  the  phrasing  of  the  repeated  sentence 
had  been  changed  upon  repetition  (Rothkopf  and  Coke,  1966). 
Repeated  exposure  to  the  entire  written  passages  resulted 
in  increasing  post-test  performances  with  a  maximum  effect 
appearing  after  two  such  inspections  (Rothkopf,  1968). 
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Furthermore,  findings  also  suggested  that  the  amount  of 
learning  relative  to  each  reinspection  of  the  written 
passage  decreases,  causing  the  learning  curve  to  exhibit  a 
negative  acceleration.  Finally,  performances  on  most 
post-tests  indicate  that  inserted  questions  generally 
have  a  larger  measurable  effect  on  the  retention  of  informa- 
tion relevant  to  the  questions  than  the  incidental 
information  (Prase,  1968b). 

In  studies  concerned  with  the  influence  of  hypothetical 
mathemagenic  activity  such  as  inspection  behavior,  it  is 
important  to  demonstrate  that  instructional  events  do 
exert  an  influence  upon  the  activity  and  accordingly  a 
direct  instructional  effect  upon  acquisition.  Direct 
instructional  effects  have  been  reported  by  many  studies 
(Hershberger,  1964;  Keislar,  1960;  Rothkopf,  1963,  1965, 
1966;  Rothkopf  and  Coke,  1966)  which  generally  contributed 
■the  effect  to  the  repetition  and  practice  learners  perform 
when  responding  to  content  loaded  questions.   However,  in 
order  to  demonstrate  that  the  performance  on  a  post-test 
is  due  to  modified  inspection  behavior  and  not  practice 
and  repetition  of  content  within  questions,  an  experimental 
technique  is  required.   An  explanation  of  this  technique 
will  perhaps  clarify  some  of  the  research  findings 
associated  with  hypothetical  mathemagenic  activity. 

Generally,  studies  using  questions  are  incidental 
learning  studies  where  performances  are  measured  on  a 
second  set  of  questions  similiar  to  the  experimental 


13 


questions.  The  experimental  questions,  often  referred  to 
as  adjunct  questions,  are  those  placed  at  various  locations 
within  the  instructional  text  material  itself.   However, 
the  information  necessary  to  answer  the  second  set  of 
questions,  usually  included  on  a  post-test  with  the 
experimental  questions,  is  identified  as  information 
incidental  to  the  experimental  questions.   Hence,  if  a 
mathemagenic  activity,  such  as  inspection  behavior,  has 
been  influenced  positively,  the  subjects  receiving  the 
experimental  questions  inserted  into  the  instructional 
material  ought  to  acquire  more  incidental  information 
than  those  subjects  who  do  not  receive  the  experimental 
questions.   In  this  manner,  any  measured  change  between 
groups  cannot  be  attributed  to  direct  instructional  effects 
of  the  question's  content. 

An  important  characteristic  of  questions,  in  addition 
to  their  potential  to  influence  hypothetical  activity 
related  to  learning,  is  their  position  in  relation  to  the 
relevant  content.  Ample  evidence  is  available  to  support 
the  findings  that  a  simple  change  in  position  can  radically 
transform  consequent  behaviors  associated  with  reading. 
Several  studies  (Bruning,  1968;  Frase,  1967,  1968a; 
Rothkopf,  1966;  Rothkopf  and  Bisbicos,  1967)  show  that 
experimental  questions  administered  shortly  after  inspecting 
the  text  segment  to  which  they  are  relevant  produce 
significant  gains  in  incidental  learning.   Questions  when 
placed  before  relevant  text  material  were  found  to  provide 
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significant  depressing  effects  upon  acquisition  of 
Incidental  learning  (Frase,  1968;  Rothkopf,  1970).   It 
was  also  found  that  when  the  frequency  of  questions 
placed  before  readings  was  increased,  the  acquisition  of 
incidental  and  relevant  information  decreased.   Questions 
inserted  into  text  and  placed  after  relevant  segments  of 
readings  were  found  to  promote  an  increase  in  acquisition 
of  incidental  and  relevant  information  as  their  frequency 
increased  (Frase,  1968a,  1968b).  The  general  implication 
of  these  studies  is  that  placing  relevant  questions  after 
paragraphs  may  positively  influence  both  a  review  and  a 
general  facllltatlve  effect  upon  acquisition  of  information. 

Most  experimental  uses  of  questions  inserted  into 
textual  material  have  been  designed  to  elicit  responses 
best  described  as  factual  recall.   While  questions  asked 
in  school  learning  situations  are  certainly  focused  on  more 
complex  responses,  taxonomies  currently  in  popular  use 
lack  the  precision  needed  in  order  to  identify  or  specify 
these  more  complex  responses  (Frase,  1970).   In  view  of 
this  problem,  types  of  questions  generally  were  operationally 
defined  by  each  researcher.   Rothkopf  and  Bisbicos  (1967), 
for  example,  asked  different  types  of  questions  defined  in 
terms  of  asking  for  definitions  of  common  or  technical 
terms.   They  found  that  groups  exposed  to  inserted  questions 
with  technical  terms  had  high  recall  of  other  technical 
terms.   Frase  (1968c)  defined  questions  as  either  a 
comparative  question,  a  specific  question,  or  a  general 
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question.  Questions  were  rated  by  indicating  the  amount 
of  information  within  the  written  passage  considered  by 
the  learner  to  be  relevant  to  answering  the  question. 
Ratings  indicated  that  the  number  of  words  perceived  as 
necessary  to  answer  questions  increased  in  order  of 
specific  questions,  comparative  questions,  and  then  general 
questions.   In  a  follow  up  study  (Prase,  1970),  acquisition 
of  relevant  and  incidental  information  was  found  to  be  a 
function  of  question  type.   Here,  the  least  learning 
occurred  with  the  general  question,  the  most  with  specific 
questions.  This  was  attributed  to  the  learner  modified 
behavior  in  accordance  with  the  amount  of  information  to  be 
processed.   In  a  recent  study  (Watts  and  Anderson,  1971), 
questions  were  defined  in  terms  of  response.  Here,  names 
of  principles,  examples  from  text,  or  names  of  psychologists 
associated  with  principles  were  response  types.  Their 
findings  indicated  that  subjects  given  application  questions 
perform  significantly  better  than  subjects  with  other 
questions. 

Even  though  no  central  system  was  used  for  describing 
question  type  for  classifying  the  nature  of  the  written 
material,  certain  observations  are  possible  to  make  in 
summary.   Questions  may  stimulate  learners  to  review  the 
information  encoded  in  their  memory,  considered  as  relevant 
to  the  topic  of  the  question.   If  the  content  of  the  prose 
contains  little  information  that  seems  relevant  to  the 
question,  such  as  few  names  of  psychologists  or  technical 
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terms,  then  the  amount  of  information  for  review  is  less 
than  when  prose  contains  a  lot  of  information  similar  to 
the  topic.  This  relationship  between  question  type  and 
the  amount  of  similar  information  is  also  an  important 
consideration  when  selecting  questions  which  are  to 
influence  inspection  behavior.   If  the  prose  contains 
little  information  of  a  nature  similar  to  the  type  of 
response  required,  then  inspection  behaviors  seem  to  be- 
come exclusive  and  few  items  of  information  are  sought 
out.  This  notion  is  supported  by  research  where  similar 
responses  were  highly  predictable.  Here,  subjects  recalled 
significantly  less  incidental  information  than  subjects 
whose  responses  were  less  predictable  (Rothkopf,  1966;  Watts 
and  Anderson^  1971J- 

The  learning  that  results  from  the  insertion  of 
questions  into  instructional  materials  has  been  empirically 
associated  with  several  instructional  variables  including 
positioning,  frequency,  and  type  of  questions.  However, 
only  a  very  beginning  of  a  research  attempt  has  been  done 
to  associate  these  variables  with  learner  characteristics. 
Koran,  M.  L.  and  Koran,  J.  J.  (1972)  predicted  that  the 
pacing  of  questions  would  exhibit  varying  facilitative 
effects,  depending  upon  specific  learner  differences  in 
learning  ability.  Their  findings  indicated  that  measures 
of  learner  associative  memory  abilities  were  positively 
related  to  performance  when  subjects  received  inserted  ques- 
tions, but  unrelated  when  they  received  no  inserted  questions. 
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However,  scores  on  vocabulary  measures  were  positively 
related  to  performance  when  no  questions  or  infrequent 
questions  were  inserted  into  the  written  material. 
These  findings  support  the  notion  that  instructional 
variables,  such  as  the  pacing  of  questions,  can  enable 
learners  to  capitalize  on  various  learning  characteristics 
and  aptitudes.   The  Koran,  M.  L.  and  Koran,  J.  J.  (1972) 
study  represents  an  initial  effort  to  match  or  select 
instructional  treatment  variations  to  selected  learner 
characteristics.   Additional  research  and  replication  is 
necessary  before  decision  rules  can  be  formulated  to 
predict  the  assignment  of  learners  to  alternative 
instructional  treatments  designed  to  facilitate  their 
attainment  of  identical  outcomes. 

Implications  of  Research  on 
Mathemaqenic  Activity 

Incidental  learning  effects  in  the  aforementioned 
context  have  been  attributed  to  the  control  which  the 
questions  inserted  into  text  material  exercise  over 
mathemagenic  activities.   This  assumes  that  behaviors 
subsequent  to  the  inserted  questions  are  modified   Often 
referred  to  as  "forward  shaping"  (Watts  and  Anderson,  1971) 
questions  are  assumed  to  act  as  cues  in  that  they  indicate 
classes  of  information  that  should  be  learned.   When  this 
class  of  information  enables  the  subject  to  answer  the 
question,  he  is  reinforced  just  for  being  able  to  answer 
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the  question  and  therefore  the  likelihood  is  that  he  will 
again  look  for  this  same  kind  of  information. 

Questions,  however,  may  also  serve  to  influence  the 
learner  activity  in  another  way.  When  faced  with  the 
problem  of  answering  the  question,  the  learner  may 
mentally  review  the  information  he  considers  to  be  rele- 
vant to  the  cues  found  within  the  question.   This  mental 
review  acts  as  additional  practice,  a  variable  of  instruc- 
tion well  known  for  its  direct  effects  upon  increasing 
acquisition  of  information.  This  mental  review  has  been 
referred  to  by  Watts  and  Anderson  (1971)  as  "backward 
review." 

"Forward  shaping"  and  "backward  review"  remain  a 
prominent  controversy  without  empirical  evidence.   In  view 
of  the  plea  by  Koran,  M.  L.  and  Koran,  J.  J.  (1972)  to 
relate  instructional  variables  to  learner  characteristics, 
such  evidence  should  be  collected  in  a  fashion  as  to  enable 
an  association  of  performance  variations  with  differences 
between  Individual  learners. 

Definition  of  Variables  for 
Aptitude  X  Treatment  Interaction  Studies 

Theory  of  ATI  Research 

A  continuous  problem  related  to  the  development  of 
effective  instruction  is  that  of  determining  the  most 
effective  methods  for  training  large  numbers  of  individuals 
possessing  dissimilar  patterns  of  abilities.  A  common 
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strategy  has  been  to  seek  "the  one  best  method  of  instruc- 
tion." However,  learners  differ,  and  the  search  for  the 
one  generally  superior  method  should  be  supplemented  by 
a  search  for  multiple  ways  in  which  instruction  can  be 
varied  so  as  to  fit  the  characteristics  of  learners 
(Cronbach  and  Snow,  1969) . 

As  Cronbach  (1957)  has  argued: 

Treatments  are  characterized  by  many  dimensions; 
so  are  persons.  The  two  sets  of  dimensions 
together  determine  a  payoff  surface  .  .  .  Ulti- 
mately we  should  design  treatments  not  to  fit 
the  average  person,  but  to  fit  groups  of  students 
with  particular  aptitude  patterns  which  correspond 
to  modifiable  aspects  of  the  treatment  (pp.  680, 
681). 

An  implication  of  this  statement  is  that  we  should  not 
ignore  interactions  between  learners'  aptitudes  and  various 
instructional  treatments,  but  adapt  instructional  treat- 
ments to  learners'  aptitudes.   In  1965,  Cronbach  (1965) 
developed  a  theoretical  framework  to  deal  with  the  nature 
of  different  aptitudes  and  differing  instructional 
^treatmentB-  Be  xjaTled  these  studies  aptitude  treatment 
interaction  studies,  or  more  commonly  called  ATI  studies. 

The  concept  of  ATI  is  neither  new  nor  limited  to 
educational  settings.   In  Darwin's  view,  natural  selection 
operates  to  favor  whatever  species  or  subspecies  that  has 
characteristics  suited  to  a  particular  set  of  environmental 
conditions.   If  the  environmental  conditions  change  a 
different  kind  of  organism  is  favored.   The  concept  of 
a  single  rank  ordering  applied  either  to  organisms  or 
environments  ignores  the  fundamental  principle  that  it  is 
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the  interaction  between  the  characteristics  of  the 
organism  and  the  demands  of  the  environment  that  determines 
survival  or  elimination.   Similarly,  the  current  search 
for  ATI  is  based  on  the  premise  that  there  is  no  one  best 
educational  environment  suited  to  some  general,  average 
individual,  but  that  different  individuals  thrive  in 
different  educational  environments  suited  to  their  own 
characteristics  and  needs  (Koran,  M.  L. ,  1973). 

Practically  speaking,  an  interaction  between  aptitude 
and  treatment  is  present  when  one  instructional  treatment 
is  significantly  better  for  one  type  of  learner,  while  an 
alternative  treatment  is  significantly  better  for  a 
different  type  of  learner.   Specifically,  in  order  for 
instructional  treatments  to  exhibit  ATI,  there  must  be 
different  instructional  methods,  the  instructional  methods 
must  teach  to  the  same  objective  or  criterion,  and  there 
must  exist  one  or  more  aptitude  measures  for  which  regression 
of  criterion  scores  on  the  aptitudes  are  generally  non- 
parallel. 

There  are  essentially  two  different  interactions 
which  may  result;  they  may  be  either  ordinal  or  disordinal 
in  nature  (Cronbach  and  Snow,  1969) .   A  disordinal  inter- 
action is  one  in  which  the  regression  slopes  intersect 
within  the  range  of  the  aptitudes  being  considered,  as 
shown  in  the  figure  below. 
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Such  findings  imply,  in  general,  that  differential  assign- 
ment of  subjects  on  opposite  sides  of  the  intersection  to 
alternative  treatments  is  an  appropriate  means  for 
maximizing  learning  outcomes  (Koran,  M.  L. ,  1973).  An 
ordinal  interaction  is  present  when  the  regression  functions 
have  different  slopes,  but  one  is  superior  to  the  other 
through  the  range  of  aptitudes  being  considered. 

The  general  objective  of  ATI  research  is  to  match 
instructional  methods  or  materials  to  selected  learner 
characteristics.   Therefore,  unless  one  treatment  is 
clearly  best  for  all,  treatments  should  be  differentiated 
in  such  a  way  as  to  maximize  their  interactions  with 
aptitude  variables.   A  moderate  xmmber  of  studies  in  which 
aptitude-treatment  interactions  have  been  deliberately 
sought  (Cronbach  and  Snow,  1969;  Berliner  and  Cahen,  1973) 
provides  preliminary  evidence  to  suggest  that  subjects  may 
learn  more  easily  from  one  method  than  another.   Further- 
more, this  best  method  differs  from  subject  to  subject  and 
that  such  a  difference  between  treatments  is  related  to 
learner  characteristics. 


paJMis»Mg«s,i»B>»r.aa»eaa!aaaaa<. 


22 


For  the  purpose  of  ATI  research,  aptitude  has  been 
defined  as  an^  characteristic  of  the  individual  which 
functions  selectively  with  respect  to  learning;  that  is, 
which  facilitates  or  interferes  with  his  learning  from 
some  designated  instructional  method  (Cronbach  and  Snow, 
1969) .  This  definition  allows  such  variables  as  task- 
specific  knowledge  and  skills,  cognitive  styles, 
personality  characteristics  and  heuristic  strategies  to 
be  considered  as  well  as  the  more  traditional  cognitive 
ability  variables. 

A  major  problem  in  the  study  of  ATI  is  the  inordi- 
nately large  number  of  learner  characteristics  which  might 
be  considered  in  adapting  instruction  to  individual 
differences.  Furthermore,  few  of  these  differences  have 
been  shown  to  be  correlated  with  specific  learning  outcomes 
under  specific  instructional  methods  in  the  particular 
population  specified.   Even  the  treatments  themselves  are 
limited  in  description  which  lack  precise  identification  of 
tasX  or  treatment  variables. 

It  is  not  uncommon  in  ATI  research  to  find  two 
treatments;  one  of  which  relies  more  heavily  on  general 
ability  than  the  other.  Some  research  report  instances 
in  which  a  treatment  will  help  those  of  low  ability  while 
actually  hindering  high  ability  students  (Salamon  and  Suppees, 
In  Press;  Koran,  Snow  and  McDonald,  1971).   However,  there 
has  been  little  real  progress  to  date  in  identifying 
heuristics  for  developing  treatments  that  actually 
capitalize  on  aptitudes  other  than  general  ability. 
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Generally,  research  is  needed  to  identify  the  kinds 
of  abilities  and  processes  required  by  various  tasks.  Then, 
the  conditions  assessed  as  necessary  for  learning  the  task 
could  either  be  adapted  to  identified  individual  differences 
or  the  individual  might  be  taught  how  to  engage  more 
effectively  in  these  processes  (Glaser,  1972). 

Identification  of  Relevant  Aptitudes 

The  acquisition  and  subsequent  retention  of  informa- 
tion from  instructional  sequences  can  be  analyzed  as  a 
function  of  numerous  variables  including  learner  predis- 
positions and  variations  within  the  treatment  materials. 
While  these  variables  can  be  factor  analyzed  in  order  to 
relate  performance  to  a  number  of  reference  tests,  such  as 
analysis  must  be  guided  by  theories  of  human  learning  and 
performance  in  order  to  facilitate  the  interpretation  of 
results.  Melton's  (1967)  multiprocess  model  of  learning 
is  considered  to  be  a  suitable  framework  for  investigating 
instructional  differences  and  mediational  requirements 
between  specific  instructional  variables. 


r^  (s^) ^  R^RbRc 

Multiprocess  Model  of  Learning 
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This  model  presents  three  major  components  that  help 
interpret  certain  instructional  phenomena.  The  first  of 
these  is  a  stimulus  differentiation  component  [a^ — ^r^] 
in  which  the  subject  receives  the  physical  stimulus  [Sj^] 
and  selects  and  encodes  certain  stimuli  as  stimulus  cues 
tr,(s,)l.  The  potential  stimulus  is  considered  to  be  the 
entire  stimulus  situation  of  the  learning  environment. 
The  encoded  stimulus  becomes  the  effective  or  functional 
Stimulus  in  S-R  association,  and  reflects  learning  set, 
identification  and  categorization  factors,  as  well  as  the 
physical  stimulus.  Instructional  materials  attempt  to 
indicate  the  relevant  aspect  of  the  physical  stimulus 
through  the  selection  of  reading  passages,  questions, 
diagrams,  summaries,  and  other  instructional  components. 
From  this,  the  student  selects  particular  aspects  which 
become  the  stimulus  cues.  Directions,  instructions, 
elicitations,  or  models  that  direct  this  selection  are 
called  prompts.  The  encoded  response  [r^^Csj^)]  becomes  the 
effective  or  functional  stimulus  for  subsequent  psycho- 
logical learning  activities. 

The  response  integration  component  [RgRb^c'  ^*  ^^^ 
output  response  and  includes  certain  learning  behaviors 
such  as  naming,  classifying,  or  chaining  as  well  as  the 
specific  content  presented  in  the  instructional  materials. 
Such  behavior  may  be  a  previously  learned  unit  [R^^l  ,  or  a 
new  combination  of  units  l%\%^  ,   or  even  a  chain  of 
responses  from  one  stimulus  situation  [Rg+Rb+'^c' ' 
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The  "hookup"  is  the  connection  (Tj^  (Sj^) ^'^a^'^c' 

between  the  functional  stimulus  trj^(Sj^)],  and  the  acquired 
response  iRaRb'^cl  •   The  component  [r^(Sn,)l  presents  an 
alternative  mediational  route  for  the  connection  of  internal 
representation  of  the  physical  stimulus  and  the  acquired 
response.  The  mediational  route  is  especially  important 
in  examining  ways  learners  can  use  prior  learning  with  new 
but  recognizably  similar  stimuli.  The  associational  and 
mediational  routes  correspond  to  the  internal  processes  of 
the  task  being  analyzed. 

Differences  and  similarities  in  task  and  aptitude 
variables  involved  in  learning  from  different  modes  of 
information  within  instructional  material  may  be  repre- 
sented in  terms  of  this  paradigm.  This  representation  is 
presented  in  Table  1.  The  organization  of  ability 
measures  within  the  modes  has  been  somewhat  arbitrary. 
Measures  identified  are  sufficiently  diverse  to  suggest 
that  there  is  reason  to  consider  alternative  placement. 
Some  measures  may  also  be  characterized  by  overlapping 
several  placements.   However,  it  should  be  emphasized  that 
this  model  has  been  used  as  a  heuristic  device  in  attempting 
to  select  and  organize  task  and  ability  variables.   It  is 
not  intended  that  the  present  organization  be  accepted  as 
definitive.   Further  research  will  be  required  to  clarify 
the  use  of  this  model. 

Textual  information  presents  specifics  in  verbal  form 
and  assigns  them  meaning  by  direct  association  within  the 
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sentence  as  well  as  by  association  between  specifics  of 
different  sentences.   Subjects  reading  textual  information 
must  first  differentiate  relevant  specifics  and  their 
associations  and  then  code  these  in  memory.  Consequently, 
textual  modes  of  information  present  stimulus  differentia- 
tion tasks  that  would  require  abilities  in  comprehension  of 
verbal  information  and  short  term  memory. 

The  many  possibilities  for  meaningful  associations 
within  textual  information  increases  the  mediational 
requirements.   Subjects  learning  from  textual  information 
would  generate  an  associate  structure  for  processing  the 
various  stimulus  specifics  and  their  associations.  This 
structure  generation  would  require  many  abilities  including 
verbal  association. 

Diagramatic  information  presents  specifics  in  a 
symbolic  form  which  attains  meaning  from  both  the  symbolic 
representation,  any  labels  or  verbal  identifications 
provided,  and  its  relationship  to  the  other  parts  in  the 
diagram.   Subjects  learning  from  diagrams  with  many  parts 
and  various  modes  of  information  would  need  abilities  in 
perception  in  order  to  differentiate  stimulus  components. 
Quickly  inspecting  and  processing  multiple  kinds  of 
information,  selectively  attending  to  relevant  details 
over  incidental  ones  is  a  task  similar  to  what  is  commonly 
called  flexibility  of  closure  (Thurstone,  1944). 

Diagrams  can  be  considered  to  present  specifics 
within  an  organizational  scheir.a  of  associations  between 
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specifics  through  their  visual  proximity  and  sequence. 
While  stimulus  differentiation  may  assess  associations 
between  the  symbols  and  the  labels,  mediational  require- 
ments include  generating  some  associational  structure  for 
proximity  and  sequence.  This  task  receives  support  from 
the  diagram  itself  which  supplies  an  organizational 
structure.  Consequently,  the  mediational  requirements 
for  learning  from  diagramatic  information  could  require 
subjects  to  recall  specifics  and  associate  them  with  the 
diagramatic  structures  provided  within  the  diagrams. 

finally,  the  response  integration  for  both  modes  of 
information  require  subjects  to  recall  or  review  specifics 
and  associations  relevant  to  response  conditions.  This 
task  would  require  abilities  in  verbal  comprehension  and 
verbal  association. 

Processes  that  subjects  perform  during  a  learning 
task  are  assumed  to  be  influenced  by  external  conditions. 
These  conditions  may  include  instructional  tactics  such 
as  inserting  questions  into  textual  material  or  instructing 
subjects  to  mark  important  information.   If  these  condi- 
tions were  to  influence  processing  activity,  they  probably 
would  have  their  greatest  effect  on  tasks  where  the  tactics 
either  support  or  compensate  for  the  aptitude  required  by 
the  tasks.  Hence,  marking  important  information  would 
have  its  greatest  effect  on  tasks  where  selective  perception 
to  detail  would  be  essential,  such  as  when  learning  from 
diagramatic  information.  Probably,  subjects  with  low 
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perception  abilities  would  benefit  most  from  this  tactic. 
Questions,  on  the  other  hand,  which  identify  classes  of 
information  and  their  possible  relational  structures, 
would  have  their  greatest  effect  on  tasks  where  classes 
of  information  and  their  associations  are  not  readily 
apparent,  such  as  in  textual  information.   Subjects  with 
high  verbal  skills  would  probably  benefit  the  least  from 
frequent  questioning. 

Ability  Measures 

The  selection  of  ability  measures  for  use  in  this 
study  was  made  from  the  Kit  of  Reference  Tests  for 
Cognitive  Factors  (French,  Ekstrom,  and  Price,  1963). 
The  abilities  assessed  by  the  selected  measures  were 
believed  to  be  those  which  clearly  contribute  to  learning 
from  the  two  modes  of  information  and  are  consistent  with 
the  analysis  of  textual  and  diagrammatic  information  modes 
previously  discussed. 

The  Kit  of  Reference  Tests  -for  Cognitive  Factors 
consists  of  a  group  of  tests  representing  frequently 
obtained  factors  in  the  cognitive  ability  area.   Since 
these  tests  are  not  standardized  batteries  of  exams,  the 
manual  does  not  provide  reliability,  validity,  norms,  or 
other  information  usually  included  with  a  test  manual. 
However,  this  exclusion  is  consistent  with  the  general 
intention  that  the  tests  were  designed  for  cognitive 
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factor  research.   Users  must  calculate  reliability  of  the 
instruments  employed  using  suitable  analyses. 

A  brief  description  of  the  ability  tests  and  the 
factors  they  represent  follows. 

Hidden  Patterns  (Cf-2)  is  a  test  of  the  ability  to 
keep  one  or  more  definite  configurations  in  mind  so  as  to 
make  identification  in  spite  of  perceptual  distraction. 
The  subject  is  required  to  search  a  perceptual  field 
containing  irrelevant  or  distracting  materials  in  order 
to  find  one  given  configuration. 

Vocabulary  (V-2)  is  a  test  of  the  ability  to  under- 
stand the  English  language.   Individual  differences  are 
perhaps  most  clearly  seen  in  the  size  of  comprehensive 
vocabularies,  but  they  also  exist  with  respect  to  tests 
demanding  knowledge  and  understanding  of  grammatical 
patterns,  sentences,  idiomatic  phrases,  and  other  aspects 
of  the  English  language.  However,  vocabulary  tests  are 
more  desirable  than  tests  of  grammar  and  other  language 
features  because,  on  the  whole,  their  loadings  on  Factor  V 
are  high  and  less  likely  to  have  loadings  on  other  factors. 

Object-Number  (Ma-2)  is  a  test  of  the  ability  to 
remember  bits  of  unrelated  material.  This  factor  represents 
the  ability  to  form  and  remember  new  associations  quickly. 
Auditory  Letter  Span  (Ms-3)  is  a  test  of  the  ability 
to  recall  perfectly  for  immediate  reproduction  a  series  of 
items  after  only  one  presentation  of  the  series. 
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Number  Comparison  (P-2)  is  a  test  measuring  the  speed 
in  finding  figures,  making  comparisons,  and  charting  out 
other  very  simple  tasks  involving  visual  perceptual  speed.   It 
is  considered  to  be  the  centroid  of  several  sub-factors 
such  as  speed  of  symbol  discrimination,  speed  of  making 
comparisons,  forming  discrimination,  and  speed  of 
classification.  However,  they  also  serve  a  useful  purpose 
when  considered  as  the  unitary  concept  of  perceptual  speed. 

Independent  and  Dependent  Variables 

The  purpose  of  this  study  was  to  investigate  the 
effects  of  learner  aptitudes,  in  relation  to  inspection 
behaviors  performed  when  learning  from  written  materials. 
As  an  intervening  variable,  inspection  behavior  is  a 
hypothetical  construct  for  which  evidence  must  be  inferred. 
However,  it  is  also  considered  to  be  sensitive  to  inserted 
adjunct  questions  located  within  the  relevant  written 
material.  Whether  or  not  inspection  behavior  is  influenced 
by  the  adjunct  questions  can  be  inferred  by  comparing 
performances  on  a  post-test  performance  between  groups 
that  received  the  adjunct  questions  and  groups  that  did 
not.   Here,  differences  in  the  information  acquired  that 
is  incidental  to  the  adjunct  questions  is  considered  to 
be  an  indirect  measure  of  inspection  behavior. 

The  dependent  variables  in  this  study  Include  the 
between-group  differences  in  performance  of  incidental 
information.  Adjunct  questions,  when  they  appear  on  the 
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post-test,  are  also  dependent  measures  of  the  direct 
instructional  effects  of  the  inserted  adjunct  questions. 
Even  though  the  process  of  subjects  highlighting  informa- 
tion within  the  written  material  can  be  identified  as  an 
independent  variable,  the  resulting  patterns  of  information 
contribute  another  dependent  measure  for  inferring  the 
nature  of  inspection  activity  of  the  subjects. 

When  aptitudes  are  included  in  addition  to  the 
instructional  variables  built  into  the  instructional 
treatment,  then  differential  performance  of  the  treatment 
group  can  be  compared  by  regressing  the  aptitude  measure 
on  the  post-test  performance.   In  this  manner,  a  relation- 
ship can  be  established  between  learner  characteristics  and 
instructional  variables  that  influence  inspection  behavior 
and  acquisition.   Hence,  student  behavior,  mathemagenic 
activity,  and  the  constructs  which  influence  it  are  inde- 
pendent variables.   Aptitude  measures  are  also  independent 
measures  and  the  dependent  variables  again  become  the  post- 
test  measure  of  both  relevant  and  incidental  information 
acquired. 

Statement  of  Hypotheses 

Based  upon  the  previously  reviewed  research  and  theory, 
the  following  hypotheses  were  tested. 

1.   Subjects  receiving  treatments  with  adjunct 
questions  inserted  into  the  written  passage 
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will  exhibit  significantly  greater  acquisi- 
tion of  relevant  information  than  the 
control  group. 

2.  Subjects  receiving  treatments  with  adjunct 
questions  based  upon  diagrammatic  information 
inserted  into  the  written  material  will 
exhibit  significantly  greater  acquisition  of 
incidental  information  from  diagrams  than 
groups  that  did  not  receive  diagrammatic 
adjunct  questions. 

3.  Subjects  receiving  treatments  with  adjunct 
questions  based  upon  textual  information 
inserted  into  the  written  passage  will 
exhibit  significantly  greater  acquisition 
of  incidental  information  from  text  than 
groups  that  did  not  receive  textual  adjunct 
questions. 

4.  There  will  be  a  significant  influence  on 
performance  for  subjects  who  receive  treat- 
ments in  which  they  highlight  information 
in  the  written  materials. 

5.  There  will  be  a  differential  relationship 
between  criterion  performances  and  aptitudes 
of  subjects,  relative  to  the  treatment 
received. 


CHAPTER  II 

EXPERIMENTAL  DESIGN 

The  Design 


A  post-test  only,  control  group  design  as  described 
in  Table  2,  was  executed  with  four  experimental  and  two 
control  groups.  While  this  design  does  not  assess  enter- 
ing behavior,  it  does  permit  an  adequate  evaluation  of  the 
relative  effects  that  an  independent  variable,  question 
type,  has  upon  a  dependent  variable,  the  acquisition  of 
information  from  different  modes  of  instructional  material 
(Kirlinger,  1964,  p.  303).  This  design  also  facilitates 
asking  the  question  of  whether  or  not  questions  serve  to 
stimulate  review  or  shape  the  inspection  behavior  of  the 
subsequent  passages.   The  design,  therefore,  provides  a 
means  for  contrasting  acquisition  after  reading  and 
answering  inserted  questions,  as  well  as  the  effect  these 
questions  had  upon  subjects'  inspection  activity  within 
each  reading  passage.   Hence,  the  written  materials  were 
selected  to  include  both  texts  and  diagrams  as  sources  of 
information.   Questions  were  then  written  that  required 
information  from  either  one  or  the  other  source.  High- 
lighting, or  marking  with  a  yellow  felt-tip  marker,  was 
used  to  monitor  the  inspection  behavior  of  the  subject. 
34 
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Aptitude  Measurements 

Subjects  were  tested  after  their  participation  in 
the  experimental  procedures.  As  shown  in  Table  3,  test 
time  was  limited  to  a  single  forty-five  minute  period 
during  the  school  day  due  to  the  constraints  encountered 
in  the  cooperating  schools.  The  tests  were  assembled 
into  a  single  booklet  and  administered  using  an  audio- 
recording  of  all  the  necessary  instructions,  practice 
exercises,  times,  and  additional  auditory  test  materials 
as  required  by  certain  tests. 

While  all  subjects  could  not  be  tested  at  one  time, 
groups  were  all  tested  in  a  like  manner.   Since  members  of 
each  class  had  previously  been  randomly  assigned  to  one  of 
the  six  treatment  groups,  any  regressive  effects  caused  by 
testing  during  classes  of  a  regular  school  day  were  also 
randomly  distributed  to  all  treatments. 

Tests  were  hand  scored  by  a  trained  rater,  working 
under  the  direction  of  the  experimenter.  Objective  test 
scoring  keys  were  used  on  all  tests.  The  scores  reported 
were  always  the  number  of  items  right  except  on  those  tests 
where  choices  were  dichotomous;  here,  scores  were  cal- 
culated by  subtracting  wrong  choices  from  correct  choices 
in  order  to  correct  for  guessing. 
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Treatment  Procedures 
Subjects 

Nlt.th  through  twelfth  grade  students  enrolled  in  high- 
school  chemistry  and  physics  were  identified  as  suitable 
subjects  on  the  basis  of  the  complexity  and  scientific 
nature  of  the  content  presented  in  the  written  materials. 
A  total  of  185  subjects  were  selected  from  two  local  high 
schools.   Relevant  characteristics  of  these  treatment 
samples  appear  in  Table  4. 

General  Procedures 

Subjects  participated  in  the  experiment  during  the 
period  that  they  normally  would  have  had  a  chemistry  or  a 
physics  class.   Since  these  classes  are  seldom  found  to 
have  students  who  are  alike  in  ability  or  interest, 
subjects  within  each  class  were  randomly  assigned  to  one 
of  the  six  treatments. 

After  subjects  were  given  a  brief  introduction  to 
the  experiment,  they  were  provided  with  the  appropriate 
booklet  containing  both  the  treatment  materials  and  the 
post-test.   Highlighters  (yellow  felt-tip  pens)  were 
provided  for  subjects  assigned  to  treatment  which  required 
them. 

Although  a  common  practice  is  to  read  all  directions 
aloud  to  all  subjects  in  order  to  encourage  closer 
compliance,  this  was  not  feasible  in  this  experiment 
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since  subjects  during  administration  had  different  treat- 
ments and  hence  different  directions.  Therefore,  they 
were  instructed  to  read  the  directions  carefully  and 
independently. 

Four  sets  of  directions  were  written.   Subjects 
that  were  assigned  to  treatments  with  inserted  questions 
were  given  a  page  of  -Directions  for  Answering  Study  Items." 
(All  direction  pages  are  included  in  Appendix  A.)   Study 
item  directions  informed  subjects  that  self-test  questions 
would  be  given  at  the  end  of  each  reading  passage  and  that 
they  should  attempt  to  recall  the  information  necessary 
and  attempt  to  answer  it,  even  if  their  answer  is  only  a 
guess.  Only  subjects  that  were  in  treatments  with  high- 
lighting were  given  a  page  of  -Directions  for  Highlighting, - 
which  demonstrated  how  to  highlight  both  text  and  diagram 
portions  of  the  reading  passage.   Subjects  were  directed 
to  highlight  all  the  information  they  considered  important 
and  worth  remembering  in  order  to  answer  the  post- test 
items.  All  subjects  were  given  a  page  of  -General  Direc- 
tions" which  encouraged  them  to  read  and  study  both  the 
diagrams  and  the  written  information;  these  directions  also 
informed  them  that  a  set  of  test  items  would  be  given 
after  all  reading  passages  asking  for  specific  information 
from  each  passage.   All  subjects  were  given  a  page  of 
-Directions  for  Answering  Test  Items-  at  the  conclusion  of 
all  treatment  materials.   The  subjects  were  encouraged  to 
answer  all  questions,  even  if  some  answers  were  guesses. 


41 

Treatment  Materials 
Written  Passages 

Seven  reading  passages  were  selected  from  Dr.  Posin's 
Giants  (Posin,  1961) .   (These  passages  are  included  in 
Appendix  B.)   This  number  was  found  to  be  the  maximum 
number  that  most  students  could  complete  with  enough  time 
remaining  for  the  post-test  within  the  constraints  of  a 
forty-five  minute  class  period.  Each  passage  is  about  225 
words  long  and  is  presented  on  two  pages  with  one  diagram 
on  each  page.  Diagrams  were  modified  to  include  labels. 
The  number  of  sentences  in  "-he  text  varied  from  eight  to 
twenty,  while  the  number  of  spv^-^*'       "ded  in  the 
diagram  varied  from  ten  to  twenty.  The  content  presented 
in  the  diagram  and  text  contained  redundant  as  well  as 
independent  specifics.  The  latter  information  became  the 
content  for  questions . 

Questions 

Questions  varied  in  terms  of  the  source  of  the  in- 
formation needed  for  a  response.   One  type  of  question 
required  information  from  the  text  while  a  second  type 
required  information  from  diagrams.   Question  complexity 
was  controlled  in  that  all  were  limited  to  the  recall  of 
specific  information,  such  as  the  names  of  symbols, 
objects,  definitions,  events,  properties,  or  processes. 
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Four  questions  were  written  for  each  passage;  two  of 
these  asked  for  text  information  and  two  for  diagram 
information.   Each  of  these  questions  were  then  assigned 
to  one  of  four  groups:  Relevant  Text  Questions,  Incidental 
Text  Questions,  Relevant  Diagram  Questions,  Incidental 
Diagram  Questions.  As  a  result,  the  composition  of  each 
set  of  questions  contained  one  question  from  each  passage. 
Treatments  with  inserted  questions  received  either  the 
Relevant  Text  Questions  or  Relevant  Diagram  Questions. 
(These  questions  are  included  in  Appendix  C  and  D  respec- 
tively.) All  questions  were  combined  and  randomly 
ordered  to  make  up  the  post-test.   (The  post-test  is 
Included  in  Appendix  E.) 

(Juestions  were  tested  in  order  to  determine  their 
relative  independence.  Questions  are  considered  to  be 
independent  when  knowing  the  response  to  one  question 
does  not  cue  the  subject  to  a  correct  response  for  the 
others.   Independence  must  be  established  for  questions 
in  this  study  in  order  to  assume  that  between-group 
performance  differences  on  Incidental  questions  is  due  to 
differences  in  inspection  behavior.   Subjects  (N=60) 
were  randomly  assigned  to  three  groups.   One  group  was 
given  the  fourteen  pairs  of  questions  with  Relevant 
questions  answered,  the  second  group  was  given  the  same 
questions  with  Incidental  questions  answered,  and  the  third 
group  was  given  the  same  questions  with  neither  set  of 
questions  answered.   The  means  and  standard  deviations  for 
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all  groups,  in  addition  to  the  results  from  ANOV  tests 
for  significant  differences  are  reported  in  Table  5.  The 
insignificance  of  the  F  test  was  accepted  as  sufficient 
evidence  that  knowing  the  responses  to  one  set  of  questions 
does  not  contribute  to  answering  the  other  set  of  questions. 
Therefore  the  two  sets  of  question  pairs  were  considered  to 
be  independent. 

Reliability  of  Measures 

Twenty-eight  questions  were  written  comprising  the 
criterion  measure.  A  point  bi-serial  correlational 
technique  was  selected  to  evaluate  their  reliability.  This 
technique  is  considered  to  be  a  suitable  means  to  estimate 
a  question's  potential  to  discriminate  between  subjects 
%rtio  score  in  the  top  half  and  those  in  the  bottom  half  of 
the  group  being  tested.  A  point  bi-serial  correlation  of 
0.222  (p  < .01)  was  considered  minimum  for  acceptable 
reliability  for  individual  criterion  items.  Bi-serial 
correlations  for  the  questions  are  reported  in  Table  6. 
Reliabilities  of  all  questions  were  found  to  be  acceptable. 
The  difficulties  for  the  twenty-eight  questions  were 
calculated  and  are  also  reported  in  Table  6.   Difficulty, 
here,  is  defined  to  be  the  percent  of  the  subjects  failing 
to  answer  the  question  correctly.   The  higher  the  percent, 
the  more  difficult  the  item.   The  mean  difficulty  was 
0.669,  while  the  range  of  difficulties  varied  from  0.174 
to  0.940.   The  research  on  the  effects  of  questioning  and 
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TABLE  6 


RELIABILITY  AND  DIFFICULTY  OF 
POST-TEST  QUESTIONS 


Question  Difficulty           Reliability* 
1 7^2?  TTJi       ~ 

2  .418  .384 

3  .745  .341 

4  .940  .333 

5  .766  .221 

6  .462  -442 

7  .712  .419 

8  .592  .457 

9  .652  .521 

10  .554  .365 

11  .174  .420 

12  .440  .355 

13  .848  .321 

14  .641  .497 

15  .929  .297 

16  .739  .358 

17  .908  .387 

18  .484  .522 

19  .832  .363 

20  .533  .407 

21  .848  .321 

22  .511  .446 

23  i4«4  .511 
14  .886  .384 

25  .641  .434 

26  .880  .298 

27  .815  .263 
28 .^ .473    .521 

T^p   .01)  =  .222  ~ 

df  =  183 
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mathemagenlc  activity  does  not  report  any  data  concerning 
the  difficulty  of  the  question,  hence  all  questions  were 
accepted  as  suitable,  even  though  they  were  difficult. 

As  Draper  and  Smith  (1966,  p.  29)  point  out,  measures 
with  excessive  error  variance  and  hence  low  reliability 
contribute  to  insignificance  of  regression  where  signifi- 
cance could  exist.   Hence,  reliabilities  using  the  Cronbach 
alpha  (1970)  were  calculated  not  only  for  the  post-test 
and  ability  measures,  but  also  for  all  part  scores  as  well. 
These  reliabilities  are  reported  in  Table  7.   Generally, 
the  reliabilities  for  the  post-test  and  the  ability 
measures  were  acceptable.  The  reliabilities  of  the  part 
scores  were  accepted  even  though  they  were  somewhat  lower. 
This  low  reliability  was  attributed  to  the  relatively  few 
items  that  were  used  to  determine  these  part  scores. 

Methods  of  Data  Collecting 

Subjects  recorded  their  answers  in  a  booklet  clearly 
labeled  with  vital  personal  information.  One  set  of  booklets 
Was  constructed  to  contain  the  necessary  treatment  materials 
and  post-test  while  a  second  set  contained  the  aptitude 
measures.   The  booklets  were  then  scored  and  data  transfer- 
red to  a  "Data  Summary  Form"  (Included  in  Appendix  F) .   From 
these  forms,  necessary  data  were  transferred  to  IBM  cards. 
Duplicate  sets  of  data  cards  were  made  in  order  to  facili- 
tate multiple  analysis  and  data  security.   Key  punching. 


TABLE  7 
RELIABILITY  OF  MEASURES 
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Measure 


Number  of 
Items 


Criterion  Measures 

Post-test  28 

Relevant  Text  Questions  7 

Incidental  Text  Questions  7 

Relevant  Diagram  Questions  7 

Incidental  Diagram  Questions  7 

Ability  Measures 

Hidden  Patterns  (Cf-2)  200 

Vocabulary  (V-2)  36 

Object-Number  (Ma-2)  15 

Auditory  Letter  Span  {Ms-3)  15 

Number  Comparison  (P-2)  48 


Reliability 


.78 


.48 
.51 


.47 
.4€ 


.91 

.71 

.73 
.56 
.85 


f™'^™='='-"-""'» 
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scoring,  and  analysis  were  performed  by  trained  technicians 
under  the  direction  of  the  experimenter. 


CHAPTER  III 
RESULTS 

The  primary  objectives  of  this  study  were 

1.  to  assess  the  relative  effects  of  different 
instructional  variables  upon  inspection 
behavior,  and 

2.  to  explore  the  effects  of  individual  differences 
on  learning  from  different  modes  of  instruc- 
tional content. 

This  chapter  will  describe  the  statistical  tests  of 
the  hypotheses  and  the  results  achieved.  The  presentation 
of  results  will  first  treat  the  instructional  treatment 
main  effects  and  then  the  aptitude  x  treatment  interactions. 
Most  analyses  were  computed  using  the  University  of  Florida 
Statistical  Programs  Library. 

Independent  and  Dependent  Measures 

Inspection  behavior  is  an  intervening  variable 
credited  with  influencing  the  acquisition  of  information 
from  instructional  material,  such  as  prose.   However,  the 
study  of  inspection  behavior  is  limited  to  the  analysis  of 
indirect  evidence.   This  evidence  can  be  identified  as 
either  an  independent  or  dependent  measure.   Independent 
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measures  include  those  which  potentially  may  predict  a 
learner's  performance  relative  to  a  specified  instruc- 
tional treatment.  As  presented  in  Table  8,  this  study 
included  independent  measures  generally  described  as 
aptitudes,  time,  and  inserted  question  scores.   Dependent 
measures  included  evidence  describing  performance  variables 
which  were  influenced  in  some  way  by  experimental  manipu- 
lation.  In  this  study,  dependent  measures  (Table  8) 
included  post-test  measures  for  the  acquisition  of  relevant 
and  incidental  information  from  textual  and  diagrammatic 
portions  of  the  written  passages,  and  percentages  of 
diagrammatic  or  textual  information  highlighted  within 
written  passages. 

Intercorrelations  Among  Measures 

Intercorrelations  of  both  independent  and  dependent 
measures  were  computed  for  the  total  sample.  For  the  most 
-part,  the  intercorrelations  among  the  independent  measures 
(Table  9)  display  low  correlations  with  one  another, 
particularly  among  the  factor  tests.   This  is  in  accordance 
with  the  expectations  regarding  correlations  among  factor 
tests  that  purport  to  measure  different  things,  hence  tend 
to  be  independent.   Intercorrelations  among  the  dependent 
measures  (Table  10) ,  revealed  some  higher  correlations 
among  post-test  measures,  in  particular,  between  the  sets 
of  diagram  question  scores.   In  general,  other  dependent 
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measures  of  time  and  highlighting  displayed  lower  corre- 
lations with  one  another  as  well  as  with  other  dependent 
measures. 

Distribution  of  Scores  Within  Measures 

Means,  standard  deviations,  and  distributions  of 
both  independent  and  dependent  measures  were  computed  for 
the  total  sample.  The  means  and  standard  deviations  for 
the  independent  measures  are  presented  in  Table  11,  and 
for  the  dependent  measures,  Table  12.  The  distributions 
of  these  scores  by  treatment  group  are  presented  in 
Appendix  G.  An  inspection  of  these  means,  standard  devia- 
tions, and  distributions  indicated  that  most  data  did  not 
appear  to  deviate  from  a  normal  distribution  to  warrant 
further  testing.  However,  scores  on  post-test  measures 
displayed  some  grouping  generally  credited  to  the  limited 
range  of  the  scores  and  to  the  high  difficulty  of  the 
items . 

Instructional  Treatment  Main  Effects 

The  following  hypotheses  were  of  major  concern 
relative  to  instructional  treatment  main  effects: 

1.   Subjects  receiving  treatments  with  adjunct 
questions  inserted  into  the  written  passage 
will  exhibit  significantly  greater  acquisition 
of  relevant  information  than  the  control  group. 
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2.  Subjects  receiving  treatments  with  adjunct 
questions  based  upon  diagrammatic  information 
inserted  into  the  written  material  will  exhibit 
significantly  greater  acquisition  of  incidental 
information  from  diagrams  than  groups  that  did 
not  receive  adjunct  questions. 

3.  Subjects  receiving  treatments  with  adjunct 
questions  based  upon  textual  information 
inserted  into  the  written  passage  will  exhibit 
significantly  greater  acquisition  of  incidental 
information  from  text  than  groups  that  did  not 
receive  textual  adjunct  questions. 

4.  There  will  be  a  significant  influence  on 
performance  for  subjects  who  receive  treatments 
in  which  they  highlight  information  in  the 
»oritten  materials. 

Treatments  were  named  according  to  the  type  of 
questions  that  were  inserted  into  the  written  passage 
and  whether  or  not  highlighting  was  performed.  Hence,  a 
treatment  named  •" text  questions  with  highlighting  (TQ/H) " 
describes  a  treatment  with  text  questions  inserted  into 
the  written  passages  with  subjects  assigned  to  that  treat- 
ment highlighting  textual  and  diagrammatic  information 
within  the  passages  according  to  directions  provided. 
Subjects  assigned  to  any  one  of  six  treatments  (described 
in  Table  2) ,  all  completed  the  same  post-test.   It  is 
these  post-test  scores  and  the  percent  of  text  or  diagram 
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information  highlighted  within  the  written  passage  that 
the  analysis  for  instructional  main  effects  was  performed. 

A  two  (levels  of  highlighting)  by  three  (types  of 
inserted  questions)  analysis  of  variance  test  was  used  to 
determine  if  there  were  significant  instructional  treatment 
effects  on  the  various  post-test  scores.   In  accordance 
with  Winer  (1971)  ,  when  a  significant  F  ratio  occurred 
between  two  of  the  three  types  of  inserted  question  treat- 
ment conditions,  a  Scheffe  test  procedure  was  completed  to 
determine  the  location  of  the  significant  differences. 

Acquisition  of  Relevant  and  Incidental  Information 

Information  in  this  study  was  defined  to  be  relevant 
when  it  was  the  intended  answer  to  the  inserted  question. 
All  other  information  was  identified  as  incidental.   Hence, 
questions  on  the  post-test  that  are  the  same  as  those 
inserted  into  the  written  passage  become  the  measures  for 
the  acquisition  of  relevant  information.   These  questions 
are  identified  as  relevant  diagram  questions  and  relevant 
text  questions.   The  other  questions  therefore  ask  for 
incidental  information  and  are  identified  as  incidental 
diagram  questions  and  incidental  text  questions.   These 
four  subsets  of  post-test  questions  were  analyzed  to 
determine  the  instructional  main  effects  relative  to  the 
acquisition  of  incidental  and  relevant  information. 

An  inspection  of  the  means  for  all  treatment  condi- 
tions, as  reported  in  Table  13,  identified  potential 
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between  group  differences  relative  to  performance  on  the 
subsets  of  post-test  questions.  The  results  of  the 
analysis  of  variance  on  each  set  of  scores  from  the 
subsets  of  questions  are  reported  in  Table  14.   Signifi- 
cant between  group  differences  were  found  for  the  inserted 
question  treatment  condition  for  both  relevant  diagram 
questions  (F=6.32,  p<.05)  and  relevant  text  questions 
(F°8.94,  p<.01).   A  comparison  between  pairs  of  treatment 
condition  groups  using  the  Scheffe  test  procedure  was 
performed  for  both  the  relevant  diagram  questions  (Table 
15)  and  the  relevant  text  questions  (Table  16) .   Subjects 
who  received  text  questions  inserted  in  the  written 
passages  performed  significantly  better  on  the  relevant 
text  question  post-test  measure  than  subjects  who  received 
either  diagram  questions  or  no  questions  inserted  in  the 
written  passages.  Furthermore,  subjects  who  received 
diagram  questions  inserted  in  the  written  passages  also 
performed  significantly  better  on  the  relevant  diagram 
questions  post-test  measure  than  the  other  subjects.  No 
comparison  was  made  to  see  if  inserted  diagram  questions 
had  a  greater  effect  upon  the  acquisition  of  relevant 
diagrammatic  information  than  inserted  text  questions 
might  have  upon  the  acquisition  of  relevant  text  information. 

No  significant  differences  occurred  between  treatment 
conditions  and  performances  on  incidental  text  questions 
or  incidental  diagram  questions. 
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A  significant  difference  did  occur  between  high- 
lighting treatment  condition  relative  to  performance  on 
relevant  diagram  questions  (F=6.45,  p<.05) .  Generally 
those  subjects  who  did  not  highlight  within  written 
passages  performed  significantly  better  on  measures  of 
relevant  diagrammatic  information  than  those  who  performed 
highlighting  activity. 

Overall  Post-test  Performance 

Overall  post-test  performance  was  calculated  by 
counting  the  number  of  items  correct  within  all  subsets 
of  post-test  questions.  The  means  for  these  scores  by 
treatment  condition  is  reported  in  Table  17.  While  some 
differences  between  the  means  occurred,  no  significant 
differences  were  found  between  any  treatment  conditions, 
as  reported  in  Table  18. 

Highlighting  Effects 

The  highlighting  activity  of  subjects  was  measured 
in  terms  of  the  percentage  of  sentences  of  text  or  the 
percentage  of  specifics  of  a  diagram  marked  with  the  yellow 
felt-tip  marker.   The  number  of  sentences  and  specific 
parts  of  diagrams  within  each  written  passage  is  reported 
in  the  coding  sheet  used  in  computations  of  highlighting 
measures  (See  Appendix  F) .   The  percent  of  the  number  of 
sentences  highlighted  was  computed  by  dividing  the  number 
highlighted  by  the  number  of  sentences  in  the  written 
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TABLE  18 

ANALYSIS  OF  VARIANCE 
TOTAL  POST-TEST  PERFORMANCE 


Source  of  Variation 

df 

MS 

F 

Inserted  Questions 

2 

10.279 

0.44 

Highlighting/No  Highlighting 

1 

26.196 

1.13 

Questions  x  Highlighting 

2 

24.026 

1.04 

Within 

179 

23.154 

IS^^ES^SaSBBi 
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passage.   (Highlighting  all  or  part  of  a  sentence  or 
specific  part  was  counted  as  one.)   The  same  procedure 
was  followed  for  computing  the  percent  of  diagrammatic 
specifics  highlighted.  These  percents,  when  computed  for 
each  written  passage  (Table  19  and  20) ,  were  considered  to 
be  repeated  measures  of  highlighting  activity  across  the 
seven  written  passages. 

An  analysis  of  variance  with  repeated  measures  was 
performed  to  assess  the  changes  in  highlighting  activities 
frm  passages  one  through  seven.  One  analysis  was  per- 
formed on  percentage  of  diagrams  highlighted  and  another 
on  percentages  of  text  highlighted.  These  analyses,  as 
presented  in  Table  21,  disclosed  no  significant  differences 
for  either  diagram  or  text  highlighting  activity  between 
treatment  conditions  over  all  passages.  However,  a 
significant  interaction  occurred  between  passages  and 
treatment  conditions  for  both  the  highlighting  of  diagrams 
{F=2.99,  p<.01)  and  the  highlighting  of  text  (F=2.19,  p<.05). 
In  accordance  with  Winer  (1971),  tests  for  simple  main 
effects  were  performed,  as  reported  in  Table  22.   These 
tests  disclosed  significant  treatment  effects  for  only  one 
passage  for  text  highlighting  (passage  4,  F=5.59,  p<.01) 
and  two  passages  for  diagram  highlighting  (passage  4,  F=5.80, 
p<.01;  passage  7,  F=6.70,  p<.01). 

Comparisons  were  performed  on  the  significant  passages 
using  the  Newman-Keuls  procedure  (Table  23,  24,  and  25).   In 
passage  four,  treatments  receiving  inserted  diagram  ques- 
tions highlighted  significantly  more  diagram  information 
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(p<.01)  than  other  treatment  conditions.   Also,  treatments 
with  no  inserted  questions  highlighted  significantly  more 
textual  information  (p<.01)  than  other  treatments.   In 
passage  seven,  treatments  with  text  inserted  questions 
highlighted  significantly  less  (p<.01)  diagram  information 
than  other  treatments. 

An  alternative  view  of  the  effect  of  different  in- 
structional treatments  upon  the  amount  of  information 
highlighted  is  furnished  by  the  within  group  analysis  of 
the  changes  from  a  base  rate  of  highlighting  activity 
across  subsequent  written  passages,  as  reported  in  the 
analysis  for  simple  main  effects.  Table  22.  An  increase 
in  highlighting  activity  was  found  to  be  significant  for 
all  treatment  conditions  (p<.01)  for  diagram  information. 
Decreases  were  found  to  be  significant  for  highlighting 
text  information  for  all  treatments  (p<.01).  The  effects 
of  these  treatment  conditions  upon  highlighting  activity 
are  illustrated  in  Figure  1  and  2. 

Aptitude  X  Treatment  Interactions 

The  following  hypothesis  was  of  major  concern 
relative  to  aptitude  x  treatment  interactions: 

1.  There  will  be  a  differential  relationship 

between  criterion  performances  and  aptitudes 
of  subjects,  relative  to  the  treatment 
received. 
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Correlations  of  Ability  Measures 
to  Performance 

The  major  purpose  of  this  study  was  to  examine  the 
effects  of  individual  differences  in  relation  to  acquisi- 
tion of  relevant  and  incidental  information  from  written 
materials  containing  two  modes  of  instructional  content. 
In  terms  of  the  model  previously  proposed  by  Melton  (1967) 
for  investigating  individual  differences  in  learning, 
ability-performance  relationships  may  be  expected  to  vary 
as  a  function  of  the  nature  of  the  task.   It  was  antici- 
pated that  the  requirements  of  learning  from  a  textual  mode 
and  a  diagrammatic  mode  of  information  presentation  were 
sufficiently  different  to  produce  different  ability- 
performance  relationships. 

A  first  step  in  evaluating  these  theoretically 
expected  relationships  was  to  compute  for  each  group 
separately,  the  correlations  between  all  aptitudes  and 
the  post-test  performance  measures.   The  correlations  were 
then  reassembled  by  post-test  measure  so  that  the  correla- 
tions for  a  specified  measure  for  all  treatments  would 
appear  within  the  same  table  in  order  to  facilitate 
inspection.   These  individual  treatment  group  correlations 
are  reported  in  Tables  26  through  30.   Upon  inspection  it 
was  apparent  that  in  several  instances  the  correlations 
between  aptitudes  and  performance  measures  varied  sub- 
stantially across  treatment  conditions.   Aptitude  variables 
were  then  selected  for  further  investigation  of  aptitude  x 
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treatment  interaction  when  they  demonstrated  a  variation 
across  treatment  conditions  of  about  .40  between  two  or 
more  correlations  and  when  the  majority  of  the  correlations 
were  significantly  different  from  zero. 

Evaluation  for  Aptitude  x 
Treatment  Interactions 

Aptitude  X  treatment  interactions  were  evaluated  by 
comparing  regression  slopes  for  different  treatments,  using 
F  tests  for  heterogeniety  of  regression.  Although  many  P 
tests  were  calculated  and  few  were  significant,  generally 
those  F  tests  that  were  significant  followed  closely  to 
the  theoretically  expected  relationships. 

A  basic  consideration  of  aptitude  x  treatment  inter- 
action is  the  notion  that  instructional  treatments  be 
adapted  to  the  individual  differences  of  the  learner.   How- 
ever, instruction  can  be  adapted  only  when  there  are 
alternative  treatments  leading  to  the  same  terminal  objec- 
tive, and  only  if  the  regression  of  criterion  scores  on 
aptitude  scores  of  one  treatment  intersects  the  regression 
for  cm  alternative  treatment  (Cronbach,  1965).   Consequently, 
while  the  results  of  all  computed  regression  analyses  are 
reported,  only  those  analyses  which  disclosed  significant 
interactions  have  been  presented  in  graphic  form.   Sub- 
sequent discussion  and  interpretation  of  these  interactions 
were  based  upon  the  illustrations. 
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Acquisition  of  Relevant  and  Incidental 
Information  from  Diagraini' 

Results  of  regression  analysis  for  aptitude  x  treat- 
ment interaction  using  the  scores  on  relevant  and 
incidental  diagram  questions  as  the  performance  measure, 
are  summarized  in  Table  31.  These  results  disclosed  that 
treatment  time  and  relevant  diagram  questions  produced 
significant  interactions  (F=2.30,  p<.01).  This  interaction 
is  illustrated  in  Figure  3.  For  treatment  conditions  with 
Inserted  diagram  questions  with  highlighting  (DQ/H) , 
inserted  text  questions  without  highlighting  (TQ/NH) ,  and 
no  inserted  questions  with  highlighting  (NQ/H) ,  treatment 
was  positively  related  to  scores  on  relevant  diagram 
questions  and  hence  subjects  assigned  to  these  treatments 
exhibited  a  higher  level  of  acquisition  as  they  spent  more 
time  in  the  treatment.  For  treatment  conditions  with  no 
inserted  questions  without  highlighting  (NQ/NH) ,  a  negative 
relationship  was  observed  and  hence  subjects  assigned  to 
this  treatment  generally  performed  better  when  they  took 
less  time.   Treatment  conditions  with  inserted  diagram 
questions  without  highlighting  (DQ/NH)  and  inserted  text 
questions  with  highlighting  (TQ/H)  displayed  almost  no 
relationship  between  performance  on  relevant  diagram 
questions  and  treatment  time.   In  addition,  the  specific 
interaction  between  the  two  no  inserted  questions  treatment 
conditions,  with  highlighting  and  without  highlighting 
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(NQ/H,  NQ/NH),  appears  to  be  a  disordinal  interaction  with 
an  intersection  at  about  twenty  minutes. 

The  number  of  inserted  questions  answered  correctly 
and  the  performance  on  relevant  diagram  questions  also 
produced  significant  interactions  (F=5.41,  p<.01).   Scores 
for  all  treatments  with  inserted  questions  were  positively 
related  to  scores  on  relevant  diagram  questions.  While 
subjects  in  treatments  with  inserted  diagram  questions 
exhibited  only  a  slight  advantage  over  subjects  with 
inserted  text  questions,  generally  the  slopes  of  the 
inserted  diagram  questions  were  steeper  than  those  for 
treatments  with  inserted  text  questions.  The  generally 
positive  relationship  between  inserted  questions  and 
performance  on  relevant  diagram  questions  indicates  that 
subjects  answering  more  inserted  questions  exhibit  better 
performances  on  the  post-test,  even  when  the  questions  are 
dissimilar  to  the  inserted  ones.  This  interaction  is 
illustrated  in  Figure  4. 

No  significant  interactions  were  disclosed  for 
incidental  diagram  questions. 

Acquisition  of  Relevant  and  Incidental 
Intormation  from  the  Texts 

Regression  analysis  using  scores  on  relevant  and 
incidental  text  questions  as  performance  measures  are 
summarized  in  Table  32.   These  analyses  show  significant 
interactions  for  the  object-number  aptitude  measure 
(F=2.52,  p<.05),  treatment  time  (F=4.06,  p<.01),  and 
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inserted  questions  (F=3.04,  p<.05).  Treatment  time  also 
produced  significant  interactions  with  incidental  text 
questions  (F=2.65,  p<.05). 

The  effects  of  object-number  measures  upon  post-test 
performance  is  illustrated  in  Figure  5.  Object-number 
aptitude  measure  is  a  measure  of  associative  memory. 
Generally,  treatments  with  inserted  text  questions  with 
or  without  highlighting  (TQ/H,  TQ/NH)  were  positively  re- 
lated to  high  performance  on  relevant  text  questions.  The 
treatment  with  inserted  diagram  questions  without  high- 
lighting (DQ/NH)  was  negatively  related  while  other 
treatments  demonstrated  either  a  weak  or  non-existant 
relationship.   It  is  also  interesting  to  note  that  regres- 
sion lines  for  treatments  with  inserted  text  questions  are 
generally  steeper  and  higher  than  those  for  inserted 
diagram  questions. 

As  illustrated  in  Figure  6,  treatment  time  exhibited 
a  strongly  positive  relationship  to  performance  on  relevant 
text  questions  for  treatments  with  inserted  text  questions 
without  highlighting  (TQ/NH) ,  and  no  inserted  questions 
with  highlighting  (NQ/H) .   The  steep  and  generally  higher 
regression  lines  for  these  treatments  would  suggest  that 
subjects  assigned-to  these  treatments  would  not  only 
benefit  from  increased  time  spent  in  the  treatment,  but 
also  that  they  generally  performed  better  than  subjects  in 
other  treatments.   A  negative  relationship  was  found 
between  performance  and  treatment  time  for  treatments  with 
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inserted  text  questions  and  highlighting  (TQ/H) ,  inserted 
diagram  questions  without  highlighting  (DQ/NH) ,  and  no 
inserted  questions  without  highlighting  (NQ/NH)  indicating 
that  additional  time  spent  in  the  treatment  did  not  produce 
higher  performance  on  the  relevant  text  questions.  The 
treatment  with  inserted  diagram  questions  and  highlighting 
(DQ/H)  exhibited  no  relationship  to  time. 

The  number  of  inserted  questions  answered  correctly 
was  positively  related,  as  illustrated  in  Figure  7,  to  all 
treatments,  but  strongly  related  to  treatments  with  inserted 
text  questions  as  these  were  the  same  as  the  relevant  text 
questions  on  the  post-test.  However,  answering  inserted 
questions,  even  when  they  were  diagram  questions  when 
accompanied  with  highlighting  also  seemed  to  facilitate  a 
higher  performance  on  post-test  performance  on  relevant 
text  questions.  An  exception  seems  to  be  the  treatment 
with  inserted  diagram  questions  without  highlighting  (DQ/NH) . 
Here  a  relationship  is  almost  non-existant  between  inserted 
questions  and  performance. 

Post-test  performance  on  incidental  text  questions  is 
considered  to  be  a  measure  of  incidental  learning.  The 
effects  of  treatment  time  on  this  performance,  as  illustrated 
in  Figure  8,  indicates  that  treatment  conditions  with  no 
inserted  questions  and  highlighting  (NQ/H)  and  text  questions 
without  highlighting  (TQ/NH)  have  a  facilitative  effect  upon 
incidental  learning.  All  other  treatments  are  negatively 
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related,  especially  inserted  diagram  questions  without 
highlighting  (DQ/NH)  which  demonstrated  a  strong  negative 
relationship. 

Overall  Post-test  Performance 

Results  of  regression  analysis  using  the  total  of 
all  post-test  questions  as  a  performance  measure  are 
summarized  in  Table  33.  These  analyses  show  that  scores 
on  treatment  time  and  total  post-test  questions  interacted 
significantly  (F=3.49,  p<.05).  This  interaction  is  illus- 
trated in  Figure  9.  Generally,  treatment  time  was 
positively  related  to  scores  on  total  post-test  performance 
for  treatment  conditions  with  text  questions  without  high- 
lighting (TQ/NH)  and  no  questions  with  highlighting  (NQ/H) , 
and  negatively  related  to  treatment  conditions  with  no 
questions  without  highlighting  (NQ/NH) ,  diagram  questions 
without  highlighting  (DQ/NH) ,  and  text  questions  with 
highlighting  (TQ/H) ,  while  diagram  questions  with  high- 
lighting (DQ/H)  displayed  almost  no  relationship.  Therefore 
subjects  assigned  to  either  treatments  with  text  questions 
without  highlighting  (TQ/NH)  or  no  questions  with  high- 
lighting (NQ/H)  were  able  to  perform  better  on  the  post-test 
when  they  spent  more  time  in  the  treatment.   Subjects 
assigned  to  treatments  diagram  questions  without  highlight- 
ing (DQ/NH) ,  or  no  questions  without  highlighting  (NQ/NH) 
and  text  questions  with  highlighting  (TQ/H)  generally 
performed  better  when  they  spent  less  time  in  the  treatment. 
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CHAPTER  IV 

DISCUSSION  AND  IMPLICATIONS 

Summary  of  Data;  Hypotheses  Tests 

This  study  sought  to  examine  the  effects  of  verbal 
and  perceptual  aspects  of  learner  aptitude,  in  relation 
to  inspection  behavior  performed  while  learning  from 
written  materials  containing  two  modes  of  instructional 
content.   Some  general  premises  basic  to  this  study  include 
the  following: 

1.  The  physical  stimulus  presented  to  the  learner 
during  instruction  is  not  in  simple  correspondence 
to  the  effective  stimulus  encoded  by  the  learner, 
and  that  it  is  the  effective  stimulus  which  be- 
comes the  basis  for  subsequent  psychological 
learning  activity. 

2.  The  various  internal  processing  activities  which 

contribute  to  the  encoding  of  an  effective 

stimulus  can  be  influenced  by  elements  in  the 

physical  stimulus.   Therefore,  acquisition  of 

information  from  an  instructional  situation 

varies  as  a  function  of  the  prompts  and  cues 

Included  in  the  instructional  material  and 

environment. 
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3.  The  effectiveness  of  different  instructional 
material  varies  from  individual  to  individual 
with  differences  being  correlated  with  individual 
aptitudes. 
Specific  predictions,  although  tentative,  were  based 
on  theoretical  considerations  which  suggest  that  require- 
ments of  different  modes  of  instructional  content  were 
sufficiently  different  to  produce  different  ability- 
performance  relationships. 

Instructional  Treatment  Main  Effects 

Acquisition  of  relevant  information. — The  first 
hypothesis  tested  was: 

1.   Subjects  receiving  treatments  with  adjunct  ques- 
tions inserted  into  the  written  passage  will 
exhibit  greater  acquisition  of  relevant  information 
than  the  control  group. 
As  previously  defined,  information  is  identified  as 
relevant  when  it  is  the  intended  response  to  an  inserted 
question.   Therefore,  when  a  subject  can  respond  correctly 
to  the  relevant  post-test  questions,  which  are  identical 
with  the  inserted  question,  his  performance  is  evidence  for 
the  acquisition  of  relevant  information.   Support  for  this 
hypothesis  is  dependent  upon  significant  between  group 
differences  in  scores  on  relevant  post-test  questions.   The 
appropriate  statistical  tests  of  this  hypothesis  are  there- 
fore comparisons  of  performances  on  relevant  text  or 


102 

diagram  questions  by  pairs  of  treatment  conditions  follow- 
ing an  overall  significant  F  ratio.  The  data  in  Table  14 
strongly  supported  this  hypothesis. 

In  general,  when  subjects  answered  questions  within 
the  written  passage,  they  also  performed  better  on  those 
same  questions  on  the  post-test  than  subjects  who  did  not 
receive  the  questions  within  the  written  passage.   Hence, 
subjects  who  received  inserted  diagram  questions  also 
performed  better  on  the  relevant  diagram  questions  on  the 
post-test.  The  same  was  true  of  subjects  receiving  inserted 
text  questions  in  that  their  performance  was  better  than 
other  subjects  on  relevant  text  questions  on  the  post-test. 
This  finding  is  consistent  with  earlier  studies  (Rothkopf, 
1966}  Rothkopf  and  Bisbicos,  1967?  Frase,  1970)  where  it 
was  shown  that  the  insertion  of  questions  in  written  instruc- 
tional material  increases  the  amount  learned  from  the  text 
when  they  occur  after  the  written  passage  to  which  they 
relate. 

The  facilitative  effects  of  questions  appearing  after 
the  written  passage  upon  the  acquisition  of  relevant  informa- 
tion is  often  identified  as  a  direct  instructional  effect  of 
questions.  This  effect  recognizes  that  the  content  load  of 
the  question  itself  provides  additional  opportunity  for  the 
acquisition  of  that  information  in  subsequent  questions  with 
similar  content  loads.   The  repetition  and  practice  learners 
perform  when  responding  to  content- loaded  questions  would 
suggest  that  a  relationship  should  exist  between  answering 
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the  question  correctly  and  the  performance  on  the  relevant 
post-test  questions.  This  expectation  was  confirmed  by 
regression  analysis  where  positive  relationships  were 
disclosed  between  the  number  of  inserted  questions  answered 
and  the  performance  on  the  corresponding  relevant  questions. 
This  relationship  occurred  for  both  inserted  diagram  and 
inserted  text  questions  treatment  conditions  (Figure  4  and 

7). 

In  summary,  both  the  significant  between-group  differ- 
ences aad  the  positive  relationships  between  performances 
on  inserted  questions  and  relevant  post-test  questions 
support  the  hypothesis  that  inserted  questions  facilitate 
acquisition  of  the  relevant  information  from  both  diagrams 
and  text.   In  addition,  the  mechanism  involved  in  both 
cases  can  be  identified  as  the  direct  instructional  effects 
of  the  content  load  of  the  inserted  questions  on  inspection 
behavior  and  subsequent  acquisition  of  similar  content  in 
passages  that  follow. 

Acquisition  of  incidental  information.— The  second 
and  third  hypotheses  tested  were: 

2.   Subjects  receiving  treatments  with  adjunct 

questions  based  upon  diagrammatic  information 
inserted  into  the  written  material  will  exhibit 
significantly  greater  acquisition  of  incidental 
information  from  diagrams  than  groups  that  did 
not  receive  diagrammatic  adjunct  questions. 
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3.  Subjects  receiving  treatment  with  adjunct  ques- 
tions based  upon  textual  information  inserted 
into  the  written  passage  will  exhibit  significantly 
greater  acquisition  of  incidental  information  from 
text  than  groups  that  did  not  receive  textual 
adjunct  questions. 
Information  is  considered  to  be  incidental  when  it  is 
not  an  intended  response  to  the  questions  inserted  into  the 
written  passages.  Acquisition  of  incidental  information 
is  measured  by  performance  on  post-test  questions  that 
are  not  the  same  as  those  inserted  into  the  written  passage. 
While  the  inserted  questions  also  appearing  on  the  post-test 
are  called  relevant  post-test  questions,  these  are  called 
incidental  post-test  questions.  Support  for  these  hypotheses 
is  dependent  upon  significant  between-group  differences  in 
scores  on  incidental  post-test  questions.  The  appropriate 
statistical  tests  of  these  hypotheses  are  therefore  compari- 
sons of  performances  on  incidental  text  or  diagram  questions 
by  pairs  of  treatment  conditions  following  an  overall 
significant  F  ratio.  The  data  in  Table  14  were  collected 
to  test  these  hypotheses.  However,  the  non-significant  F 
ratios  for  between-group  differences  on  Incidental  post-test 
questions  for  both  diagram  and  text  information  fail  to 
support  hypotheses  2  and  3. 

Evidence  for  incidental  learning  is  measured  on  post- 
test  questions  that  are  not  the  same  as  those  inserted  into 
the  text.  Therefore,  two  additional  performances  should  be 
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considered;  first,  performances  on  relevant  text  questions 
when  the  treatment  condition  was  inserted  diagram  questions, 
and  second,  performances  on  relevant  diagram  questions  when 
the  treatment  condition  was  inserted  text  questions.  The 
comparisons  of  these  performances  reported  in  Table  15  and 
16  disclose  that  treatments  with  inserted  text  questions  did 
not  perform  significantly  better  on  the  relevant  diagram 
questions  than  treatment  conditions  with  no  inserted 
questions.  The  lack  of  significance  was  also  found  between 
treatments  with  inserted  diagram  questions  and  no  inserted 
questions  relative  to  their  performance  on  the  relevant 
text  questions.  This  additional  evidence  also  fails  to 
support  hypotheses  2  and  3. 

The  effects  of  inserted  questions  in  written  passages 
provides  a  means  to  contrast  acquisition  of  relevant  and 
incidental  learning.  While  the  analysis  of  variance  and 
subsequent  comparisons  proved  to  be  insignificant,  regres- 
sion analysis  between  the  number  of  inserted  questions  and 
the  performance  on  another  set  of  relevant  post-test 
questions  was  generally  positive.   Here,  treatments  with 
inserted  text  questions  displayed  a  positive  relationship 
to  performance  on  relevant  diagram  questions  but  regression 
slopes  were  somewhat  less  steep  and  not  as  high  as  treatments 
with  inserted  diagram  questions  (Figure  4) .   A  similar 
relationship  (Figure  7)  occurs  between  treatment  conditions 
with  inserted  diagram  questions  and  their  performance 
relative  to  relevant  text  questions.   These  observations 
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are  consistent  with  the  observation  that  an  additional 
multiplier  is  involved  when  considering  the  relative 
facilitative  effects  of  inserted  questions  upon  relevant 
versus  incidental  learning.*  This  multiplier  refers  to  the 
fact  that  the  relevant  information,  as  measured  by  the 
relevant  post-test  questions,  represents  fairly  limited 
sized  population  of  content  while  the  incidental  informa- 
tion, represents  a  much  larger  sized  universe  of  content. 
Subjects  in  the  treatment  groups  with  the  relevant  inserted 
questions  are  cued  to  the  Information  necessary  for  acquisi- 
tion in  order  to  produce  better  post-test  performances. 
Therefore,  they  can  attend  to  less  information  than  subjects 
in  other  treatments  would  have  to  consider  in  order  to 
achieve  the  same  post-test  performance.   It  is  therefore 
hard  to  tell  how  powerful  the  influence  of  inserted  ques- 
tions really  is  on  these  two  performances,  even  when  the 
post-test  questions  are  the  same. 

In  summary,  the  evidence  collected  does  not  generally 
support  hypotheses  2  and  3.  However,  inserted  questions 
may  have  actually  exerted  a  great  influence  on  the  acquisi- 
tion of  incidental  information.   Partial  explanation  of 
this  lies  in  the  fact  that  the  incidental  post-test  questions 
have  sampled  only  a  very  small  portion  of  the  incidental 
content  as  compared  to  the  100  percent  sampling  of  the 
relevant  content. 


*E.  Z.  Rothkopf,  personal  communication. 
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Highlighting  effects.— The  fourth  hypothesis  tested 

was: 

4.  There  will  be  a  significant  influence  on  performance 
for  subjects  who  receive  treatments  in  which  they 
highlight  information  in  the  written  materials. 
Support  for  this  hypothesis  is  dependent  upon  signifi- 
cant between  group  differences  in  post-test  scores  for  groups 
that  highlighted  and  those  that  did  not.  The  appropriate 
statistical  test  of  this  hypothesis  is  a  significant  F 
ratio.  Data  in  Table  14  indicated  that  subjects  who  did 
not  highlight  diagrams  performed  significantly  better  on 
the  relevant  diagram  questions  than  those  who  did  highlight 
diagrams.  No  significant  differences  were  found  between 
those  who  highlighted  text  and  those  who  did  not,  even 
though  the  means  for  highlighting  text  groups  were  generally 
lower  than  the  non-highlighting  text  groups, 

Turther  analysis  of  highlighting  activity  by  applying 
a  repeated  measures  analysis  using  the  amount  of  information 
highlighted  as  the  repeated  measure  across  written  passages 
revealed  that  the  change  in  the  percent  of  information 
highlighted  from  the  base  rate  for  passage  one  increased 
for  diagrams  but  decreased  for  texts.   Another  analysis 
using  regression  techniques  comparing  time  spent  in  the 
treatment  to  performance  on  relevant  post-test  questions 
revealed  that  highlighting  activity  and  performance  were 
confounded  with  the  time  spent  in  the  treatment.   Generally, 
when  subjects  in  treatment  conditions  that  included 
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highlighting  activity  spent  little  time  in  the  treatment, 
their  performances  were  generally  poorer  on  the  post-test 
questions  than  subjects  who  spent  more  time.   However, 
when  they  spent  less  time  without  highlighting,  their 
performances  improved  (Figure  3) .   Since  highlighting 
activity  for  diagrams  increased  across  the  written  passages, 
the  amount  of  time  required  to  do  the  highlighting  would 
also  increase.  The  chance  exists  that  the  activity  of 
highlighting  may  occur  without  attending  to  detail  and  in 
some  cases  the  subject's  attention  may  have  been  placed  on 
the  activity  of  highlighting  itself. 

When  highlighting  and  no  highlighting  were  compared 
using  regression  analysis  for  treatment  conditions  without 
questions,  an  interesting,  potential  disordinal  interaction 
occurred  (Figure  3)  between  treatment  time  and  performance 
on  relevant  diagram  questions.  When  a  short  time  was  spent 
studying  written  materials  (treatment  time) ,  subjects 
benefited  most  by  not  spending  the  extra  effort  or  time 
trying  to  highlight  important  information.  However,  high- 
lighting provided  a  chance  to  facilitate  acquisition  when 
study  time  in  the  treatment  exceeded  about  twenty  minutes. 
While  highlighting  may  hinder  the  subject's  inspection 
activity  during  a  short  study  time,  highlighting  seemed  to 
facilitate  performance  during  longer  time  periods.   This 
facilitative  effect  may  be  due  to  the  influence  of  high- 
lighting activity  to  maintain  the  focus  of  attention  during 
long  periods  of  time  when  the  tendency  would  be  to  shift  the 
focus  of  attention  to  distractions. 
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In  sumnary,  highlighting  activity  seems  to  inhibit 
performance  on  relevant  post-test  questions,  according  to 
differences  between  group  means.   However,  when  highlighting 
occurred  without  any  inserted  questions,  a  positive  relation- 
ship occurred  between  time  and  relevant  post-test  performance, 
indicating  that  highlighting  potentially  may  exert  an  influence 
upon  inspection  behavior  in  a  similar  manner  as  inserted  ques- 
tions. When  combined  with  inserted  questions,  the  effects  of 
highlighting  are  not  always  positive  and  in  some  cases  in- 
hibit performance,  as  reflected  by  differences  between  mean 
performances.  While  the  beneficial  effects  of  highlighting, 
when  they  occur,  have  been  interpreted  as  a  means  to  focus 
attention  to  important  specifics,  this  type  of  treatment  was 
found  to  interfere  with  the  achievement  of  high  performances. 
This  finding  is  consistent  with  studies  where  a  high  amount 
of  repetition  or  attention  to  detail  fails  to  produce  the 
higher  performance  (Rothkopf  and  Coke,  1966;  Rothkopf,  1968). 
Evidentally,  in  the  practice  of  highlighting  activity,  the 
learner  may  read  the  passage  and  then  go  back  and  highlight 
(often  immediately)  what  he  considered  to  be  important.   It 
may  well  be  that  this  unmeasured  delay  in  highlighting,  when 
it  occurs,  is  an  important  variable  confounded  with 
highlighting. 
Aptitude  X  Treatment  Interactions 

The  fifth  hypothesis  tested  was: 

5.   There  will  be  a  differential  relationship  between 

criterion  performances  and  aptitudes  of  subjects, 

relative  to  the  treatment  received. 


no 

This  hypothesis  implies  disordinal  interactions 
between  aptitude  and  treatment.  More  specifically,  the 
regression  line  relating  aptitude  to  criterion  scores 
under  one  treatment  intersects  the  regression  line  for  the 
alternative  treatment.  The  statistical  tests  of  this 
hypothesis  are  significant  F  tests  for  heterogeneity  of 
regression  (Cronbach  and  Snow,  1969) . 

The  evidence  with  respect  to  hypothesis  5  consists 
primarily  of  interactions  between  treatment  time  and  post- 
test  performance  and  one  aptitude  factor  test  interacting 
with  post-test  performance.  While  treatment  time  -may  seem 
to  be  an  unlikely  aptitude,  aptitude  has  been  defined  as 
any  characteristic  of  the  learner  which  facilitates  or 
interferes  with  his  learning  from  some  designated  instruc- 
tional method  (Cronbach  and  Snow,  1969) . 

Treatment  time. — Analysis  of  treatment  time  with 
respect  to  post-test  performance  revealed  that  treatments 
with  text  questions  without  highlighting  and  no  inserted 
questions  with  highlighting  displayed  a  consistently 
positively  relationship  with  performance  on  both  relevant 
and  incidental  post-test  questions.   Hence,  subjects  who 
spent  more  time  in  the  treatment  generally  scored  higher 
when  assigned  to  these  treatment  conditions.  Of  special 
interest  are  treatments  of  no  inserted  questions  without 
highlighting,  inserted  text  questions  without  highlighting, 
and  inserted  diagram  questions  without  highlighting  which 
demonstrated  consistently  negative  relationships  between 
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treatment  time  and  post-test  performance  on  relevant  and 
incidental  information  as  well  as  on  an  overall  post-test 
performance.  When  subjects  spent  more  time  in  these  treat- 
ments, their  performances  attenuated. 

Taken  as  a  whole ,  the  patterns  of  treatment  time  and 
performance  relationships  suggests  that  the  effects  of 
questions  inserted  into  the  written  passages  or  highlighting 
can  facilitate  acquisition.  However,  when  both  are  present, 
a  heavy  burden  is  placed  upon  the  physical  doing  within  the 
treatment  materials  producing  in  some  cases  a  poorer  per- 
formance suggesting  that  the  treatment  has  interfered  with 
effective  processing  of  the  material  or  attenuated  perform- 
ance through  boredom  or  fatigue.  A  similar  effect  was 
observed  for  treatments  with  only  inserted  diagram  questions 
and  no  inserted  questions.  Evidentally,  these  conditions 
provide  little  influence  and, as  a  result  the  learner  adapts 
less  productive  behaviors,  at  least  in  terms  of  time. 

In  summary,  how  a  learner  spends  his  time  acquiring 
information  from  instructional  material  is  of  basic  impor- 
tance when  it  can  be  shown  that  time  and  performance  are 
concomitant  variable  within  instructional  conditions. 

Aptitude  factors. —The  initial  aptitude  factors  for 
this  study  were  selected  on  the  basis  of  an  analysis  of 
learning  from  diagrammatic  and  textual  mode  of  instructional 
material,  identifying  the  tasks  and  processes  corresponding 
to  a  model  proposed  by  Melton  (1967)  for  the  investigation 
of  learning  and  individual  differences.  A  summary  of 
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individual  differences,  identified  by  the  aptitude  factor 
tests  utilized,  is  presented  below  (sununarized  from  page  26) 


Sj^ >•  J^i^Si^ 

Hidden  Patterns  Object-Number   _ 

Number  Comparison  Auditory  Letter  Span 

Vocabulary 

Organization  of  Aptitude  Factor  Tests 
in  a  Multi-process  Model  of  Learning 

Of  the  five  aptitude  factors  studied,  only  the  object- 
rtumber  factor  test  was  found  to  significantly  interact  with 
treatment  conditions,  relative  to  performance  on  the 
relevant  text  questions.  An  analysis  of  this  interaction 
with  the  relevant  text  questions  (Figure  5)  indicates  that 
subjects  who  scored  high  on  the  object-number  test  also 
benefited  most  from  treatments  with  text  questions  with  or 
without  highlighting  activity  and  least  from  diagram  ques- 
tions without  highlighting- 

The  object-number  test  of  associative  memory  presents 
explicit  pairs  of  objects  and  numbers  that  the  subjects  are 
asked  to  learn.   They  are  told,  in  taking  the  test,  that 
they  will  be  allowed  to  study  the  list  of  object-number 
pairs  and  then  will  be  asked  to  write  the  number  for  the 
same  objects,  but  only  arranged  in  a  different  order.   Hence, 
the  nature  of  the  associations  to  be  formed  is  quite  clear 
for  this  particular  test  as  well  as  for  other  tests  of 
associative  memory  (French,  Ekstrom,  and  Price,  1963). 
However,  in  learning  from  written  materials,  subjects  must 
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identify  the  meaningful  associative  pairs  within  or  between 
sentences  and  then  commit  them  to  memory.   In  the  present 
experiment,  questions  could  conceivably  be  formed  from 
nearly  every  sentence.  The  cues  provided  by  text  questions 
identify  important  associated  information  and  permit 
subjects  to  capitalize  on  associative  memory.   In  other 
words,  the  insertion  of  questions  serve  to  clarify  the 
nature  of  the  associations  to  be  formed  and  thus  allow 
associative  memory  to  be  more  effectively  utilized.   This 
finding  is  consistent  with  other  research  (Koran,  M.  L.  and 
Koran,  J-  J.,  1972)  where  treatment  conditions  with  high 
frequency  of  inserted  questions  displayed  a  positive  rela- 
tionship between  incidental  post-test  questions  and  the 
scores  on  the  first-last  names  test  of  associative  memory. 
The  fact  that  individual  differences  have  more  often  been 
found  for  incidental  learning  than  relevant  learning  has 
been  presumed  to  be  caused  by  the  higher  motivation  to 
learn  relevant  information,  thus  obscuring  differences  in 
learner  habits  and  sets  (Plunderleith  and  Postman,  1957). 
However,  most  other  research  that  has  found  these  differences 
for  incidental  learning  utilized  college  aged  subjects, 
rather  than  the  younger  high  school  aged  subjects  used  in 
this  study.   It  is  possible  that  in  the  latter  case 
subjects  are  less  motivated  to  participate,  especially  when 
the  written  materials  are  not  part  of  their  regular  school 
work.   It  is  also  possible  that  the  high  level  of  the  ques- 
tion difficulty  has  also  limited  the  effectiveness  of 
inserted  questions. 


j^.«^-..«»l.^»-._.1. 
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The  relationship  between  associative  memory  and 
processing  of  textual  material  was  predicted  in  the  analysis 
in  Chapter  I  using  Melton's  Model  (1967).  Another  relation- 
ship was  also  predicted  between  perceptual  speed  and  learning 
from  diagrams.  Specifically,  diagrams  can  be  described  as 
a  presentation  of  specifics  within  an  organizational  schema 
of  associations,  namely  the  proximity  and  sequence  of  the 
specifics  within  the  diagram.   Here,  stimulus  differentia- 
tion is  required  in  order  to  assess  associations  between 
symbols.  Acquisition  becomes  dependent  upon  the  subjects' 
perceptual  speed  and  accuracy  in  scanning  these  specifics. 
The  number  comparison  test  was  identified  as  a  suitable 
measure  of  perceptual  speed  and  accuracy.   In  this  test, 
subjects  are  presented  with  50  pairs  of  numbers  (usually 
longer  than  six  digits  each) .  The  subject  was  to  identify 
those  pairs  that  are  not  the  identical  pairs  in  a  very 
short  period  of  time.  Here  also  both  speed  and  accuracy  of 
perception  are  important. 

In  Table  31 ,  an  interaction  of  borderline  significance 
is  reported  between  number  comparison  factor  -test  and  treat- 
ment conditions,  in  relation  to  performances  on  relative 
diagram  questions.  An  analysis  of  this  interaction  indicates 
that  performances  in  treatment  conditions  with  diagram  ques- 
tions with  highlighting  generally  performed  better  but  without 
a  strong  relationship  to  perceptual  speed  and  accuracy.   The 
same  was  found  for  all  other  treatments  with  highlighting. 
Evidentally,  highlighting  activity  as  well  as  diagram 
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questions  minimize  the  demands  upon  perceptual  speed  and 
accuracy  and  permit  subjects  to  capitalize  on  other 
aptitudes  in  the  processing  of  the  diagrammatic  information. 
VJhen  these  prompts  are  not  present  in  the  treatment  condi- 
tions, such  as  inserted  text  questions  without  highlighting 
or  no  questions  with  no  highlighting,  performances  place 
a -higher  burden  on  perceptual  speed  and  accuracy,  as 
evidenced  by  steeper  slopes.  These  latter  treatments 
require  subjects  to  find  and  accurately  identify  important 
information  within  the  diagram  without  support  of  the 
treatment  condition. 

In  summary,  highlighting  in  general  inhibited  the 
acquisition  of  relevant  diagram  information.   However,  it 
was  found  to  benefit  certain  low  ability  learners,  perhaps 
by  reducing  certain  processing  requirements  as  well  as 
enabling  them  to  capitalize  upon  others.   In  this  sense, 
the  treatment  condition  provided  compensation  for  defi- 
cient attentional  and  perhaps  discriminational  skills. 

Individual  Differences  in  Learning  Relevant 
■ and  Incidental  Information 

This  research  has  attempted  to  further  examine  the 
relationships  between  individual  differences  and  inspection 
behavior  relative  to  learning  from  different  modes  of 
instructional  content.   In  order  to  search  out  these  relation- 
ships, treatments  must  be  designed  that  capitalize  upon  the 
individual  learner's  habits  and  learning  set.   Treatments 
that  strongly  influence  these  habits  and  learning  set  usually 
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fail  to  expose  learner  characteristics  and  performance 
relationships.  Therefore,  the  fact  that  the  treatments 
in  this  study  displayed  no  major  significant  advantage  for 
one  over  another  indicates  that  they  may  be  suited  for  the 
investigation  of  aptitude  x  treatment  interaction. 

Interesting  direct  instructional  effects  disclosed 
that  inserted  questions  with  their  intended  responses 
selected  from  diagrams  were  an  effective  means  to  influence 
acquisition  of  the  intended ,  relevant  information  from  the 
diagram.  An  additional  phenomena  was  observed.  Answering 
most  of  the  inserted  text  questions  also  facilitated  acquisi- 
tion of  diagrammatic  information.  However,  answering  most 
of  the  inserted  diagram  questions  did  not  necessarily 
facilitate  acquisition  of  relevant  text  information,  unless 
the  task  also  included  the  performance  of  highlighting 
activity.  This  observation  leads  to  the  possibility  that 
the  processing  activities  are  performed  differentially. 

Generally,  processing  activity  refers  to  the  manipula- 
tions performed  by  the  learner  in  transforming  the  physical 
stimulus  to  an  encoded  stimulus.   When  he  inspects  and 
attends  to  some  material,  it  is  assumed  that  this  action 
influences  the  nature  of  the  encoded  stimulus.  While 
inspection  and  other  processing  activities  are  considered 
to  be  sensitive  to  external  influence,  the  effects  of  this 
external  influences  seems  to  occur  differentially,  relative 
to  the  individual  differences  in  aptitude  and  performance. 
In  addition,  the  effects  of  different  modes  of  instructional 
content  seem  to  increase  these  differential  effects.   Hence, 
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learners  may  be  performing  one  type  of  processing  activity 
with  diagrams  and  another  for  texts. 

How  inspection  behavior  is  influenced  and  shaped  by 
external  influences,  such  as  inserted  questions  or  high- 
lighting, has  remained  without  general  consensus  (Watts  and 
Anderson,  1971;  McGaw  and  Grotelueschen,  1972).  Considering 
the  seemingly  conflicting  roles  inserted  questions  and 
highlighting  seem  to  exhibit,  inspection  behavior  may  or 
may  not  be  influenced  in  some  of  these  cases,  and  therefore 
may  be  dependent  upon  the  mode  of  information,  the  difficulty 
of  the  material  and  questions,  and  the  relevant  learner 
characteristics.   It  is  very  conceivable  that  inspection 
behavior  alone  is  an  inadequate  explanation.  Watts  and 
Anderson  (1971)  have  suggested  that  the  review  of  informa- 
tion a  learner  performs  when  answering  a  question  also 
influences  his  performance  of  the  acquisition  of  information. 
In  this  study,  review  in  answering  inserted  text  questions 
has  possibly  helped  in  the  acquisition  of  relevant  diagram 
Information.   However,  the  review  when  answering  inserted 
diagram  questions  did  not  demonstrate  the  same  effect  on 
acquisition  of  relevant  text  information.   Here  only  when 
highlighting  accompanied  diagram  questions  did  any  facili- 
tation seem  to  occur.   If  highlighting  is  more  likely  to 
direct  inspection  behavior  rather  than  stimulate  review, 
then  the  benefit  of  highlighting  is  perhaps  due  to  a 
forward  shaping  of  inspection  behavior.   Specifically,  text 
questions  may  be  credited  with  causing  a  review  which  in 


118 

turn  facilitate  the  acquisition  of  diagrammatic  information. 
On  the  other  hand,  diagram  questions  may  cause  a  review 
but  alone  they  were  not  found  to  produce  much  acquisition 
of  textual  information.  Therefore,  it  is  probably  the 
highlighting  accompanying  the  diagram  questions  treatment 
conditions  that  influence  inspection  behavior  to  include 
text,  thereby  facilitating  the  acquisition  of  textual 
information. 

Musings  concerning  the  interaction  of  inspection  and 
review  activities  can  produce  many  fascinating  possibilities, 
especially  when  considerations  of  individual  differences 
become  an  added  component.   In  this  study,  the  role  of 
associative  memory  was  found  to  interact  with  acquisition 
from  textual  information.  No  doubt,  learners  who  formed 
associations  readily  were  thereby  able  to  review  a  greater 
variety  of  information,  and  produce  a  better  post-test 
performance.   Likewise,  learners  who  have  well  developed 
aptitudes  of  perceptual  speed  found  inspection  activities 
to  be  more  profitable  without  the  limiting  influence  of 
questions  or  highlighting. 

m  summary,  a  word  of  caution.   Direct  tests  on  the 
cell  means  of  the  data  have  generally  failed  to  reveal  any 
significant  differences  which  can  be  interpreted  as  support  for 
shaping  inspection  behavior.  Only  through  regression  analysis 
vhere   within  cell  performance  variations  were  inspected 
were  scane  of  the  above  conjectures  possible.   Beyond  the 
P  test  for  heterogenity  of  regression  lines,  no  means  was 
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available  to  determine  through  some  pair-wise  comparison 
whether  or  not  two  particular  regression  lines  were  in 
fact  significant  in  their  interaction.  Therefore,  only 
general  trends  were  discussed  unless  differences  between 
slopes  of  the  regression  lines,  as  observed  through 
graphing,  appeared  to  be  radically  different.  However, 
this  means  to  determine  "significant"  differences  is 
far  from  producing  consistently  secure  results.  Nonethe- 
less, findings  reported  and  summarized  here  have  their 
greatest  value  in  replication  with  attention  to  correcting 
and  improving  experimental  procedures. 

Mathemagenic  Behavior;   Some  Implications 
For  Future  Research 

The  observation  that  inserted  questions  facilitate 
acquisition  of  incidental  information  remains  without 
support  in  this  study  although  inserted  questions  have  been 
credited  with  influencing  the  inspection  behavior  employed 
by  the  learner  when  learning  from  written  discourse.  An 
alternate  explanation  suggests  that  inserted  questions 
stimulate  a  mental  review  of  the  information  encoded  from 
the  written  discourse.   Whether  or  not  the  involved  mathe- 
magenic activity  is  a  review  of  information  learned  or  a 
modification  of  subsequent  inspection  behaviors,  a  relation- 
ship ought  to  exist  between  the  variable,  inserted  questions, 
and  the  resulting  performance  on  the  incidental  post-test 
questions.  The  results  of  this  study  underscore  the 


120 

necessity  to  consider  other  possible  variables,  in  addition 
to  inserted  questions,  as  potential  agents  to  influence 
mathemagenic  activity.  The  nature  of  the  written  material, 
the  complexity  of  the  questions,  the  incentive  of  the 
learner  to  work  with  the  materials,  are  only  a  few  of  these 
other  contributing  variables  that  may  also  serve  to  increase 
or  decrease  the  acquisition  of  incidental  as  well  as  relevant 
information  from  instructional  material. 

Variables  Which  Hay  Influence 
Mathemagenic  Activity      ~ 

Written  materials.— Much  previous  work  in  mathemagenic 
activity  has  utilized  Rachael  Carson's  book.  The  Sea  Around 
US.  This  text  contains  an  abundant  array  of  factual  informa- 
tion.  Some  of  the  most  important  educational  goals  do  not 
entail  the  type  of  verbatim  recall  required  by  experiments 
utilizing  this  written  material  (Watts  and  Anderson,  1971). 
Therefore  other  materials  which  approximate  school 
-materials  must  be  considered  as  experimental  materials. 

One  source  of  experimental  material  is  the  myriad  of 
written  curriculum  material  produced  by  science  educators 
in  the  last  decade  and  a  half.   Few  of  these  have  ever  been 
tested  or  evaluated  in  terms  of  performance.   These  materials 
should  be  utilized  as  written  materials  in  mathemagenic 
studies  in  order  to  find  clues  for  more  effective  implementa- 
tion or  modification  of  these  materials  in  school  settings. 
One  problem  remains  concerning  the  nature  of  written 
materials.   As  discussed  in  Chapter  I  (pages  15-16)  ,  the 
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balance  between  the  type  of  content  and  the  quantity  of 
this  type  of  content  is  a  very  important  variable  in 
written  material.  Therefore,  some  suitable  schema  must 
be  developed  that  enables  the  experimenter  to  identify  the 
complexity,  variety,  and  quantity  of  the  content  within 
the  written  materials  as  the  taxonomies  presently  in 
popular  use  are  simply  inadequate  (Frase,  1970). 

Experimental  questions. — If  shaping  is  dependent  at 
all  upon  reinforcement  from  the  success  of  answering  the 
experimental  question  inserted  into  the  written  material, 
then  success  in  answering  the  question  must  be  taken  into 
consideration.   Hence,  questions  that  are  difficult  and 
provide  only  a  few  learners  with  the  opportunity  to  answer 
them  should  be  expected  to  have  little  influence  upon  inspec- 
tion activity.   In  this  study,  questions  were  relatively 
difficult  with  less  than  60  percent  of  the  subjects  answer- 
ing the  questions  correctly.   If  the  questions  were  less 
difficult,  which  could  be  achieved  perhaps  by  providing 
multiple  choice  select  items  rather  than  the  fill  in  the 
blemk  supply  items,  their  influence  upon  acquisition  could 
increase. 

In  addition,  type  of  question  has  also  been  limited 
to  the  verbatim  recall.   The  extent  to  which  relationships 
found  in  the  current  research  may  be  altered  when  questions 
require  learners  to  apply  concppts  or  principles  described 
in  a  passage  should  also  be  empirically  determined. 
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Entering  behaviors  of  learners. — Studies  in  mathe- 
magenlc  activities  generally  assume  that  the  entering 
behavior  of  the  learner  includes  processing  activities 
suitable  for  task  presented  by  the  treatment.   Studies 
concerned  with  performances  of  learners  in  school  settings 
should  recognize  the  possibility  that  some  of  the 
participants  will  not  possess  suitable  skills  for 
processing  the  materials.  Therefore,  these  studies 
involve  not  just  the  shaping  of  the  entering  behavior,  but 
also  the  more  complex  task  of  conditioning  a  suitable 
accessing  activity  into  the  repertoire  of  the  learner. 

Another  variable  among  subjects  concerns  their 
incentive  to  attend  to  presented  materials  in  the  instruc- 
tional setting.  Whether  an  experiment  or  other  regular 
school  activity,  passive  attention  and  inattention  to 
presented  materials  is  an  important  problem.  According 
to  the  notion  of  effective  stimulus,  the  role  of  the 
learner  is  tantamount  since  it  is  the  stimulus  encoded  bj^ 
the  learner  that  becomes  the  basis  for  subsequent  psycho- 
logical learning  activity.   Therefore,  what  is  not  encoded 
becomes  a  very  important  variable  when  learner  inattention 
is  a  characteristic  of  participation.   Perhaps  materials 
with  high  novelty  and  visual  presentation  can  help  redirect 
the  attention  of  wandering  learners  to  the  instructional 
material.   This  level  of  mathemagenic  activity  has  been 
generally  classified  as  an  orientating  and  acquisition 
activity,  both  subsets  of  mathemagenic  behavior. 
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Individual  differences.— The  learning  that  results 
from  the  insertion  of  questions  appears  to  be  a  function  of 
several  interacting  components,  such  as  the  variable  use 
of  questions,  differences  in  vnritten  materials,  and  the 
complexity  of  the  questions.   Aptitude  x  treatment  inter- 
action studies  attempt  to  link  these  variables  to  learner 
characteristics  since  it  is  likely  that  the  effects  of  such 
task  components  on  learning  from  vnritten  materials  varies 
for  different  subgroups  of  learners. 

The  aptitude-performance  relationships  disclosed  by 
this  line  of  research  are  far  from  direct  classroom  applica- 
tion. However,  findings  do  indicate  general  trends  and 
provide  a  potential  alternative  conception  for  individualized 
instruction.   Here,  individualized  instruction  is  based 
upon  providing  materials,  strategies  and  environments  which 
permit  learners  to  capitalize  on  their  well  developed 
abilities  and  yet  be  compensated  for  the  weaker  abilities. 

Aptitude  X  treatment  interaction  studies  are  still 
limited  by  the  "divining  rod"  measurement  of  treatment 
conditions  while  measuring  aptitudes  with  "micrometers" 
(Shulman,  1970).   However,  some  long  term  implications  can 
be  outlined.   First,  there  is  a  great  need  for  instructional 
materials  that  help  students  with  developed  aptitudes  other 
than  the  verbal  skills.   When  treatments  are  found  to  be 
positively  related  to  aptitudes  other  than  verbal  scores, 
careful  analysis  and  further  testing  should  be  done  in 
order  to  identify  the  patterns  that  may  be  used  to  redesign 
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other  instructional  materials.   Second,  the  evaluation  of 
curriculum  materials  has  too  long  focused  on  assessing 
which  material  is  best.  This  viewpoint  assumes  that  once 
found,  all  learners  can  perform  equally  well  using  the 
material.  Obviously,  knowing  which  material  is  best  on 
the  average  provides  incomplete  information  for  implementa- 
tion of  the  material  into  the  classroom.  Of  greater 
importance  are  findings  that  report  what  outcomes  learners 
can  be  expected  to  attain  using  these  materials  and  which 
learning  habits  and  aptitude  characteristics  seem  to  be 
prerequisites  for  attaining  these  outcomes  with  these 
materials.  Third,  observations  in  classroom  settings  should 
be  collected  which  reflect  the  learning  habits  and  charac- 
teristics of  learners  in  school  settings  across  many  periods 
of  time.  From  this  data,  instructional  variables  that 
attenuate  learning  can  be  identified  and  hopefully  eliminated 
while  those  variables  that  facilitate  learning  can  become 
prototypes  for  redesigning  instruction  and  instructional 
materials. 

Conclusion 

This  study  utilized  materials  that  approximated 
classroom  written  materials  for  science  instruction.   The  find- 
ings indicated  that  inserted  adjunct  questions  were  most  effec- 
tive for  acquisition  of  relevant  information;  no  evidence 
was  found  to  support  the  influence  upon  acquisition  of 
incidental  information.   Time  spent  in  the  treatment  and 
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individual  differences  in  associative  memory  were  found  to 
be  significantly  related  to  performance.  These  results 
are  generally  consistent  with  other  research  considering 
the  length  of  the  written  passages  utilized  (Koran,  M.  L. 
and  Koran,  J.  J.,  1972). 

Three  types  of  analytical  procedures  were  utilized 
in  order  to  answer  different  questions.  Between  group 
differences,  trends  across  written  passages,  and  relation- 
ships between  a  predictor  and  criterion  measure  of  perfor- 
nance  were  interpreted  as  support  or  no  support  for  research 
hypotheses.   In  general,  regression  analysis  was  identified 
to  be  consistent  with  problem  questions,  especially  those 
concerned  with  variables  which  may  influence  mathemagenic 

activity. 

Results  of  this  type  of  research  may  not  have  immediate 
and  practical  application  to  classroom  instruction.   However, 
further  experimentation  may  eventually  reveal  decision  rules 
for  modifying  instruction  and  for  assigning  learners  to 
alternative  instructional  treatments  to  teach  the  same 
terminal  objectives. 
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Student  Information  Sheet 

Please  complete  the  following  statements.  The  information 
you  provide  will  be  important,  so  please  be  accurate. 


Name: 


Year  in  School: 


Sex: Age:. 


Date; 


Record  the  time: 


GO  ON  TO  THE  NEXT  PAGE 


School :__ ' 

Teacher: Period: 


='=^Tf^-^'''^=^=*= 
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General  Directions 

It  is  important  that  you  do  your  best  throughout  these 
materials.  The  following  suggestions  will  help  you. 

Each  of  these  booklets  has  been  assembled  with  some 
differences.  You  will  notice  your  neighbor  doing  some- 
thing different  than  you  are.  You  should  ignore  him. 

The  materials  in  this  booklet  consist  of  a  series  of 
short  passages.  Each  passage  contains  some  dtajrama  and 
some  written  information. 

Study  each  passage  carefully.  You  will  want  to  remember 
some  of  it.  At  the  conclusion  of  all  the  passages,  you 
will  be  asked  to  answer  a  set  of  test  items  in  order  to 
find  out  how  much  you  remember  from  each  passage. 


GO  ON  TO  THE  NEXT  PAGE. 
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Directions  for  Answering  Study  Items 

Please  read  the  following  carefully.   It  contains  some 
important  information. 

At  the  conclusion  of  each   passage,  you  will  find  a  etudy 
item   inserted  on  a  separate  page.  This  item  will  give  you 
a  chance  to  "test  yourself"  on  recalling  information. 

Once  you  finish  studying  the  passage  and  start  working 
on  the  study  item,  DO   NOT  TURN  BACK  TO   THE  PASSAGE. 

Write  your  answers  on  the  line  provided  with  the  study 
item.   If  you  do  not  remember  the  cinswer,  it  is  alright 
to  guess. 


GO  ON  TO  THE  NEXT  PAGE 
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Directions  for  Highlighting 

While  you  are  reading  this  page,  hold  up  your  hand  and 
you  will  receive  a  yellow  felt-point  marker. 

As  you  study  the  following  passages,  you  are  to  "highlight" 
or  mark  with  the  yellow  marker  all  the  information  you 
consider  important  and  worth  remembering   in  order  to  answer 
the  test  items. 

You  may  want  to  highlight  a  sentence  or  phrase: 

Elephants  are  mammals. 

You  may  want  to  highlight  a  diagram  or  part  of  a  diagram: 


■^' 


Nhen  you  receive  a  highlighter, 


GO  ON  TO  THE  NEXT  PAGE. 


fgf=^.7M^^ja.^5iB*Mt  M^V,^#l.rtir.«n»rTt»* 
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Record  the  time: 


Directions  for  Answering  Test  Items 

Answer  the  following  test  items  as  well  as  you  can.  If 
you  cannot  remember  the  answer,  it  is  alright  to  guess. 
Your  score  will  be  based  upon  how  many  items  you  get 
right  with  NO  penalty  for  wrong  answers. 

Write  your  answers  on  the  line  provided  with  the  test 
item. 

DO  NOT  TORN  BACK  TO  ANY  OF  THE  OTHER  MATERIALS  IN  THIS 
BOOKLET. 


GO  ON  TO  THE  NEXT  PAGE. 
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Record  the  time: 


CLOSE  YOUR  BOOKLET. 


PLEASE  WAIT  QUIETLY. 


When  asked,  please  turn  in  ALL  the  materials  you  were 
given. 

THANK  YOU  FOR  YOUR  HELP. 


APPENDIX  B 
BEADING  PASSAGES 
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Planet  Paths 

Kepler,  after  analyzing  masses  of  numbers  giving  the 
positions  of  the  planets  over  a  period  of  many  years,  was 
able  to  state  that  for  some  of  the  planets  the  ellipse 
differed  very  little  from  a  circle,  whereas  for  others  the 
ellipse  is  very  much  off  center,  or  eccentric.  For  earth, 
the  eccentricity  is  not  very  great. 


Earth 


'|fll.5    1  94. S        ^ 
million       million 
milee  miles 


Earth 
Winter  in 
northernfU 
Bemiepheref'"' 


Earth 


Earth 'e  orhit 


When  satellites  are  launched  artificially,  they  always 
go  into  elliptical  orbits  around  the  earth,  or  elliptical 
orbits  around  the  sun,  if  they  are  launched  around  it.  Only 


Planet  paths  -  page  2 
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a  perfect  shot  could  hope  to  put  an  artificial  satellite 
into  a  circular  orbit.  To  achieve  a  circular  shot,  the 
firing  speed  at  a  fixed  height  above  the  earth  would  have 
to  be  precisely  one  certain  value,  and  the  satellite  would 
have  to  be  fired  precisely  in  a  predetermined  direction, 
parallel  to  the  plane  of  the  earth's  horizon  below. 

hrueU   Satellite  firing  poeition 


irole 
(perfect  oonditiona) 


^Elipeea 

(not-perfeot  oonditiona) 


Suppose  we  were  to  put  an  artificial  satellite  into  a 
circular  orbit.   Now,  suppose  we  were  to  try  a  second  time 
for  a  circular  orbit.   If  the  launching  speed  were  greater 
than  that  at  A,  we  would  get  an  ellipse  -  not  a  circle.   Or, 
if  the  direction  differed  slightly,  we  would  get  an  ellipse. 
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DO  NOT  TURN  BACK  TO  THE  READING  PASSAGE 


GO  ON  TO  THE  NEXT  PAGE 
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Electric  Effect 
Current  is  presumably  a  current  of  electrical 
particles,  and  we  call  it  a  "conduction  current."  Today 
vre  believe  that  the  flow  is  in  the  direction  of  negative  to 
positive  and  that  it  consists  of  electrons,  or  tiny  negative 
charges. 

galvanometer 

battery 
Maxwell,  however,  felt  that  there  was  more  to  this. 

He  had  a  hunch  that  we  ought  to  get  a  magnetic  field  not 

only  when  charged  particles  were  flowing,  as  in  a  wire,  but 

even  when  they  did  not  actually  flow  through  a  space.   Here 

is  what  we  mean: 


uncharged  metal  plates  charged  metal  platee 

As  the  charges  begin  to  appear  on  the  plates,  electric 
lines  begin  to  reach  across  from  say,  plate  A  to  plate  B. 
Maxwell  called  the  electric  lines  pulsing  through  space  a 
"displacement  current." 
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Electrical  effect  -  page  2 


Now,  as  the  lines  increase  in  number,  because  of  the 
charging  up  of  the  plates,  we  have  electric  lines  pulsing 
through  space.   In  Faraday's  discovery,  we  have  magnetic 
lines  pulsing  through  space  -  through  the  space  enclosed  by 
a  coil  of  wire: 


we  move 
the  magnet      ^ 


galvanometer 


And  what  happened?  An  electrical  flow  began  to  occur. 
As  a  matter  of  fact,  the  coil  is  not  absolutely  necessary. 
If  magnetic  lines  simply  pulse  through  any  space,  an 
electrical  effect  is  created  around  the  magnetic  pulse. 

Maxwell  reasoned  that  when  electric  lines  pulse 

through  a  space  -  such  as  that  between  the  two  metallic 

plates  or  any  space  at  all  -  a  magnetic  effect  should  come 

into  existence  around  the  pulsing  electric  lines. 
Battery 

1»— 


Giarged  metal  plate 


charged  meta\   •»  > 
platAy/^ 


magnetic  effeot 
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DO  NOT  TURN  BACK  TO  THE  READING  PASSAGE 


GO  ON  TO  THE  NEXT  PAGE 
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Testing  Radioactivity 

How  can  we  tell  whether  a  substance  gives  out  rays, 
that  Is,  whether  It  Is  radioactive? 


Metal  ball-- 


,  ^  Q^,,^''^ Charged  rod 
\JiJ  hae   touched 

the  metal  ball 


Thin  I 

etripB 

of  golm  f<iil 


An  Eleotroeoope 


The  gold  strips,  you  see,  take  on  the  charge,  let's  say  a 
plus  charge.  As  you  know,  like  charges  repel  each  other. 
Thus,  the  strips  move  away. 

Now,  let  us  bring  some  uranium  close  to  the  electro- 
scope. The  rays  from  the  uranium  break  up  many  atoms  of 
the  air  surrounding  the  electroscope.   Negative  charges 
from  these  atoms  drift  toward  the  positively  charged  foils. 
Gradually,  the  gold  strips  are  neutralized-  Accordingly, 
the  foils  repel  each  other  with  less  force.  Responding  to 
gravity,  they  move  in  toward  each  other. 


Testing  radioactivity  -  page  2 
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Uranium 


ball 


Ionized  air 


'Charged  eleotroaoope  discharges 


Thus,  from  the  rate  of  the  collapse  of  the  gold  strips, 
we  can  learn  how  strong  the  uranium  sample  is.  By  just 
such  a  method,  Marie  learned  that  thorium,  too,  emits  rays. 

In  1898,  after  a  long  examination  of  various  ores,  Marie 
discovered  a  new  substance  which  emitted  rays,  a  new  element, 
which  she  named  "polonium"  in  honor  of  her  native  land. 
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DO  NOT  TURN  BACK  TO  THE  READING  PASSAGE 


GO  ON  TO  THE  NEXT  PAGE 
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Star  Stability 


And  what  exactly  happens  in  general  to  a  star  that 
begins  to  lose  its  stability?  The  star  heats  up,  expands 
enormously,  and  then  cools  because  of  expansion.  After  this 
point  of  development  has  been  reached,  the  star  may  begin  to 
swell  and  contract  alternately.  On  the  other  hand,  the  star 
may  go  on  contracting  rapidly  and  cause  such  heating  up  that 
violent  nuclear  reactions  take  place,  and  it  explodes, 
blowing  itself  to  smithereens.  Only  a  small  part  of  this 
star  remains,  a  cool  "white  Dwarf"  that  fades  from  view  and 
goes  into  oblivion. 


XL  te/  '^7-^ 

\\  Qx      Begins   to 

"^y'  expand^    then 

A    nvery  hot       """^^^   oontracte 


-/rj.l^    star 
'f^'  \       begina 

^3l.         expand 


yellow 
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Will  our  sun  behave  in  this  way?  It  is  expected  that 
the  sun  will  go  through  this  routine  in  about  eight  billion 
years.  As  you  can  see,  we  have  plenty  of  time  in  which  to 
pack  our  suitcases  and  prepare  to  leave  for  the  planet  of 
another  star. 
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Water 

Lukewarm  water  is  not  at  all  a  static  substance.  Its 
average  effect,  yes,  is  that  of  a  lukewarm  condition.  But 
in  reality,  it  consists  of  fast  molecules,  slow  molecules, 
and  molecules  having  near-average  speeds.  All  these  molecules 
are  in  constant  motion,  colliding  with  each  other  and  with 
the  walls  of  the  container,  gaining  speeds,  losing  speeds, 
exchanging  speeds. 


lypioal    "over-all"  view 
f\  « 


Molecular  view 


Lukewarm  Water 


fast  moleoul 


'ng  molecules 


lukewarm  Water 


So  what?  So  it  means  that  a  chance  exists  that  by 
random  motions,  some  day,  a  significant  fraction  of  all  the 
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fast  molecules  will  gather  at  the  left,  and  a  large  number 
of  slow  ones  will  gather  at  the  right.  Then  what?  Then  the 
left  side  of  the  bucket  will  be  hot  and  the  right  side  will 
be  cold.  The  water  in  the  bucket  is  no  longer  lukewarm. 


Bigh 
Temperature- 


--Low  Temperature 


And  in  that  case,  we  are  back  where  we  started,  essen- 
tially:  the  hot  side  can  begin  to  mix  with  the  cold  side, 
and  the  world  of  the  bucket  is  at  the  beginning  of  time. 
Mixing  is  about  to  begin. 
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Galaxies 


Hubble,  with  other  astronomers,  found  an  amazing 
thing:  the  galaxies  are  running  away  from  each  other 1 

They  seem  to  be  running  away  from  us.  Yet,  it  is 
easy  to  understand  that  an  astronomer  on  another  galaxy 
would  say,  "They  are  running  away  from  us."  Can  everyone 
say  such  a  thing,  no  matter  on  which  galaxy?  Yes.  How 
about  thinking  of  it  all  this  way--  We  have  a  balloon   with 
spots  -  galaxies  -  on  it.  The  balloon  is  being  i^ated. 


galaxy" 
apot 


-spotsl 
aloee 


Expanding  balloon   "univeree" 


If  we  stand  at  A,  as  the  balloon  inflates,  every 
-galaxy-  will  be  running  away  from  us.  Yet,  when  we  stand 
at  B,  we'll  say  the  same  thing.  Every  galaxy  still  runs 

away. 

The  universe  is  expanding,  astronomers  concluded. 

What  a  remarkable  conclusion. 
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There  was  a  theory  about  a  universe  that  could  be 
expanding,  and  here  Hubble  was  bringing  in  the  observational 
facts . 

Before  I  forget,  I  want  to  say  that  not  every  galaxy 
runs  away  from  each  other.  Here  is  what  I  mean: 


'  '  ^sV"^"*^  family 


family'-       '..?^.-^jS, 


a  haohelor 


Whole  families  of  galaxies  run  away  from  each  other. 
But  members  of  an  individual  family  usually  approach  each 
other,  because  of  mutual  gravitational  attraction. 

He  still,  then,  have  an  expanding  universe. 

Incidentally,  some  of  the  galaxies  have  collided. 
They  were  probably  members  of  a  family  who  met  for  a 
reunion. 
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Temperature 

William  Thomson,  or  Lord  Kelvin,  accomplished  a  great 
deal  more  than  inventing  the  refrigerator.   He  calculated 
that  there  must  be  a  lowest  temperature  in  the  universe. 
At  such  a  temperature,  the  atoms  would  stop  moving 
completely,  and  go  to  sleep.  This  temperature  he  called 
absolute  zero. 


u-  -motionleee  moleoulee 


Would  it  make  amy  sense  to  speak  of  lower  temperatures? 
No,  not  if  we  go  along  with  the  atomic  notions.  Not  if  we 
accept  the  theories  concerning  moving  particles  and  how 
their  speeds  correspond  to  temperature.  We  like  to  speak  of 
temperature  as  beginning  at  Kelvin's  Absolute  Zero.   Doesn't 
that  make  good  sense?  So  we  have  a  Kelvin  Scale. 


Temperature  -  page  2 
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X'  "  Degrees  Kelvin     n     (^'  "  Degreee  Centigrade 


T-373  or  373'>K 

T-310  or  3J0'K 
T'-273  or   273''K 


T-0  or  O'K 


■lOO'C,    Water  Boile 


37 "C,   Body  Temperature 
O'C,   Water  Freezes 


■  273''C,   Absolute    Zero 


Lord  Kelvin  worked  out  his  absolute  scale  and  the 
absolute  zero  through  the  ideas  of  heat  flowing  toward  cold. 
We  can  think  of  a  machine  that  has  energy  given  to  it  - 
let's  say  in  the  form  of  heat.  The  machine  works.  Perhaps 
it  pushes  something.  Then  there  is  the  exhaust  heat.   If 
only  the  exhaust  could  be  at  absolute  zero I  Boy,  would  we 
have  an  efficient  machine  I 

To  get  an  exhaust  of  absolute  zero,  we  would  have  to 
squeeze  everything  out  of  the  working  fuel.  We  would  have 
to  extract  all  of  the  energy.  All  that  would  be  left  would 
be  an  absolutely  blah  exhaust.  A  really  exhausted  exhaust. 
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eOMPLETE  THE  FOLLOWING  SENTENCE: 


If  the  launching  speed  is  greater  than  a  certain  value, 
the  satellite  orbit  that  results  will  be 
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COMPLETE  THE  FOLLOWING  SENTENCE: 


When  current  is  a  current  of  electrical  particles, 
it  is  called  a 

current. 
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COMPLETE  THE  FOLLOWING  SENTENCE; 


Stars  explode  when  they  heat  up  because  of  violent 


•that  take  place. 
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COMPLETE  THE  FOLLOWING  SENTENCE: 


The  electroscope  foils  move  toward  each  other 
when  discharged  in  response  to 
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COMPLETE  THE  FOLLOWING  SENTENCE: 


The  chance  exists  that  a  significant  fraction  of  fast 
molecules  could  gather  in  one  spot  through 
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COMPLETE  THE  FOLLOWING  SENTENCE! 


Hubbel  presented 


£acts  to  support  the  expanding  universe  theory. 
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EVEN  IF  YOU  COULD  NOT  COMPLETE  THE  ABOVE  SENTENCE. 
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COMPLETE  THE  FOLLOWING  SENTENCE! 


According  to  Kelvin,  speeds  of  moving  molecules  correspond  to 


GO  ON  TO  THE  NEXT  PAGE.   DO  NOT  TURN  BACK  TO  THIS  PAGE 
EVEN  IF  YOU  COULD  NOT  COMPLETE  THE  ABOVE  SENTENCE. 


APPENDIX  D 
INSERTED  DIAGRAM  QUESTIONS 


165 
Planet  Paths  -  page  3 


COMPLETE  THE  FOLLOWING  SENTENCE. 


The  furthest  away  the  earth  gets  from  the  sun  is 


miles. 
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COMPLETE  THE  FOLLOWING  SENTENCE. 


In  Faraday's  experiment,  a 


was  used  to  measure  current  flow. 
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COMPLETE  THE  FOLLOWING  SENTENCE. 


An  electroscope  is  made  up  of  a  metal  ball  and 


GO  ON  TO  THE  NEXT  PAGE.   DO  NOT  TURN  BACK  TO  THIS  PAGE 
EVEN  IF  YOU  COULD  NOT  COMPLETE  THE  ABOVE  SENTENCE. 


168 
Star  Stability  -  page  3 


COMPLETE  THE  FOLLOWING  SENTENCE. 


A  contracting  star  becomes 


hot. 
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COMPLETE  THE  FOLLOWING  SENTENCE. 


From  the  typical  view  point,  lukewarm  water  appears  to  be 
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COMPLETE  THE  FOLLOWING  SENTENCE. 


According  to  the  article  about  galaxies,  a  single  galaxy 
is  called 
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COMPLETE  THE  FOLLOWING  SENTENCE. 


Water  freezes  at 


•Kelvin. 
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*In  Faraday's  experiment,  a 


was  used  to  measure  current  flow. 

*In  the  article  describing  the  testing  of  radioactive 
materials,  the  electroscope  was  charged 


♦According  to  the  article  about  galaxies,  a  single  galaxy 
is  called 


•The  furthest  away  the  earth  gets  from  the  sun  is 


miles. 
•Absolute  zero  is  equal  to 


Centigrade . 
•Our  sun  will  go  through  the  star  cycle  in  about 


years. 

•The  chance  exists  that  a  significant  fraction  of  fast 
molecules  could  gather  in  one  spot  through 


GO  ON  TO  THE  NEXT  PAGE. 
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^Maxwell  charged  his  electrical  plates  by  attaching  them  to  a 

•Efficient  machines  extract  all  of  the 

from  the  working  fuel. 
•Stars  explode  when  they  heat  up  because  of  violent 

that  take  place. 
•"An  ellipse  very  much  off  center"  describes 


orbit. 
•Using  &n   electroscope,  Marie  Curie  learned  that 


was  radioactive. 
•From  the  typical  viewpoint,  lukewarm  water  appears  to  be 


•Bubbel  presented 


facts  to  support  the  expanding  universe  theory. 
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*lf  the  launching  speed  is  greater  than  a  certain  value, 
the  satellite  orbit  that  results  will  be 


♦According  to  the  article  about  galaxies,  two  or  more 
galaxies  that  move  together  are  called 


The  electroscope  foils  move  toward  each  other  when 
discharged  in  response  to 


*A  contracting  star  becomes 


hot. 
*An  electrical  effect  is  created  around 


pulsing  through  any  space. 
•According  to  Kelvin,  speeds  of  moving  molecules  correspond  to 


*Fast  moving  molecules  produce  a  high 


GO  ON  TO  THE  NEXT  PAGE. 
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*An  electroscope  is  made  up  o£  a  metal  ball  and 

•Winter  in  the  northern  hemisphere  occurs  when  the  earth  is 

the  sun. 
•Expanding  stars  become 

giants. 
•Lukewarm  water  is  not  a 


substance . 
•Water  freezes  at 


Kelvin. 

•Members  of  an  individual  galaxy  family  approach  each  other 
because  of _• 

•When  a  current  is  a  current  of  electrical  particles,  it  is 

called  a  ^___ 

current. 
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Identification  number; 


School : JTeacher : Period_ 


Name: 

Year  in  School: Age: ^Sex: Datei 

Time  Measure: 

Time  start : _^_^ 

Middle: Reading  time: 


Finished: Test  time: 

Treatment  (check) ; 

Diagram  Questions       ^Highlighting 

Text  Questions         No  Highlighting 

No  Questions 

Inserted  Questions:   (1  =  correct,  0  =  incorrect) 

1.  2.   3.   4.   5.  6- T' Total  correct:_ 

Post  Test  Questions  (R=relevant,  I=incidental ,  V=very 
incidental) 

Diagram  A: Text  A: 

Diagram  B:    Text  B:     

Diagram  Total  Text  Total  

Grand  Total . 

Aptitude  Measures: 

Vocabulary  (V-2)  : ,  > 


Number-Comparison  Test  (P-2) : 

Hidden  Figures  (patterns)  (CF-2) :, 
Auditory  Letter  Span  Test  (Ma-3) :_ 
Object-Number  Test  (Ma-2) : 
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Post  Test  Questions  -  Score  Sheet 


No. 

Ident.  Quote: 

D(A)   D(B)    T(A)    T(B) 

1. 

In  Faraday's 

2. 

Elect.  Charged 

3. 

Single  galaxy 

4. 

Furthest  away 

5. 

Absolute  zero 

6. 

Our  sun  will 

7. 

Chance  exists 

8. 

Maxwell  charged 

9. 

Efficient  machines 

10. 

Stars  Explode 

11. 

Ellpse  off  center 

12. 

Using  electroscope 

13. 

Typical  viewpoint 

14. 

Hubbel  presented 

15. 

Launching  speed 

16. 

Two  galaxies 

17. 

Electroscope  foils 

18. 

Contracting  star 

19. 

Electrical  effect 

20. 

According  to  Kelvin 

21. 

Fast  Molecules 

22. 

Electroscope  made  up 

23. 

Winter  In  north 

24. 

Expanding  stars 

25. 

Lukewarm  water 

26. 

Water  freezes  at 

27. 

Members  of  family 

28. 

Current  is  a  current 
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The  following  synibols  were  used  to  represent  treat- 
ment conditions  in  the  tables  of  distributions  of  dependent 
and  independent  measures. 


Symbol:        Treatment  condition: 

DQ/H  Inserted  Diagram  Questions  with  highlighting 

TQ/H  Inserted  Text  Questions  with  highlighting 

NQ/H  No  inserted  questions  with  highlighting 

DQ/NH         Inserted  Diagram  Questions  without  high- 
lighting 
TQ/NH         Inserted  Text  Questions  without  high- 
lighting 
NQ/NH         No  inserted  questions  without  highlighting 
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DISTRIBUTION  OF  SCORES  FOR  VOCABULARY,  PART  1 


Frequency  by  treatment 

condition 

Total 

Scores: 

DQ/H 

TQ/H 

NQ/H 

DQ/NH 

TQ/NH 

NQ/NH 

Frequency 

0 

1 

1 

2 

3 

2 

1 

3 

3 

1 

2 

2 

7 
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3 

5 

4 

2 

5 

2 

19 

6 

1 

5 

1 

10 
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4 

8 

3 

4 

26 

8 

3 

2 

2 

8 

28 

9 

5 

1 

2 

2 

15 

10 

2 

6 

2 

3 

20 

11 

5 

3 

-1 

2 

15 

12 

1 

1 

7 

3 

13 

13 
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2 

1 

1 

10 

14 

1 

1 

2 

15 

2 

1 

1 

4 

16 

1 

1 

2 

4 

17 

1 

■  1 

2 

18 
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DISTRIBUTION  OF  SCORES  FOR  VOCABULARY,  PART  2 


Frequency 

by  treatment 

.  condj  tion 

Total 

Scores : 

bQ/H 

TQ/H 

NQ/H 

DQ/NH 

TQ/NH 

NQ/NH 

Frequency 

6 

1 

2 

1  • 

3 

1 

1 

1 

6 

4 

3 

1 

1 

10 

5 

3 

4 

6 

16 

6 

5 

2 

1 

19 

7 

3 

2 

3 

19 

8 

2 

4 

2 

16 

9 

2 

2 

5 

23 

10 

4 

2 

4 

17 

11 

3 

5 

14 

12 

2 

2 

3 

13 

13 

1 

1 

2 

11 
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2 

2 

2 

10 

IS 

1 
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2 
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16 
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3 

17 

1 

-  1 

18 
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DISTRIBUTION  OF  SCORES  FOR  VOCABULARY  TOTAL 


Frequency  by  treatment  condition 

Total 

Scores: 

DQ/H 

TQ/H 

NQ/H 

DQ/NH 

TQ/NH   NQ/NH 

Frequency 

S 

6 

1 

1      2 

7 

2 

1 

8 

9 

1      1 

10 

1 

2 

2 

1      2 

10 

11 

2 

1 

2 

3      2 

11 

12 

2 

3 

4 

1      3 

14 

13 

2 

1 

5 

14 

1 

1      2 

15 

2 

3 

1 

3      1 

16 

2 

4 

3 

1      1 

17 

2 

1 

1 

1      5 

18 
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2 

1 

19 

3 

3 

2 

2      1 

20 

2 

2 

21 

2 

3 

1      1 

22 

2 

1 

1 

1      1 

23 

2 

1- 

2      2 

24 

2 

3      2 

25 

1 

26 

1 

1 

1 

3      2 

27 

1 

1 

28 

29 

1 

2 

1 

30 

1 

31 

1 

1 

2 

32 

1 

1      2 

4 
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NUMBER  COMPARISON,  PART  I 


Frequency 

by  treatment 

.  condi 

tion 

Total 

Scores : 

DQ/H 

TQ/H 

NQ/H 

DQ/NH 

TQ/NH 

NQ/NH 

Frequency 

6 

i 

i 

1 

2 

2 
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3 

1 
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3 
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2 

1 

3 

7 

1 

1 

2 

8 

2 

2 

5 

4 

2 

17 

9 

3 

1 

3 

2 

2 

14 

10 

5 

3 

2 

6 

3 

27 

11 

4 

8 

2 

S 

7 

33 

12 

4 

6 

3 

2 

5 

21 

13 

2 

3 

7 

1 

2 

20 

14 

2 

2 

3 

2 

2 

12 

15 

1 

1 

1 

2 

1 

7 

16 

1 

1 

2 

1 

6 

17 

2 

1 

4 

18 

19 

1 

1 

20 

1 

1 

21 

22 

23 

1 

1 
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DISTRIBUTION  OF  SCORES  FOR  HIDDEN  PATTERNS,  PART  1 


Frequency 

by  treatment  condition 

Total 

Scores: 

DQ/H 

TQ/H 

NQ/H 

DQ/NH 

TQ/NH 

NQ/NH 

Frequency 

1-  2 

0 

3-  4 

1 

1 

3 

5-  6 

1 

7-  8 

0 

9-10 

1 

2 

1 

1 

1 

7 

11-12 

2 

2 

1 

1 

6 

13-14 

2 

2 

2 

6 

15-16 

2 

1 

1 

2 

7 

17-18 

3 

1 

2 

1 

1 

9 

19-20 

2 

1 

4 

1 

2 

13 

21-22 

2 

1 

2 

2 

9 

23-24 

3 

1 

1 

3 

8 

25-26 

3 

2 

2 

3 

12 

27-28 

4 

1 

2 

3 

11 

29-30 

1 

2 

3 

2 

2 

12 

31-32 

1 

2 

3 

8 

4 

22 

33-34 

3 

2 

2 

5 

2 

21 

35-36 

2 

2 

3 

1 

B 

37-3« 

2 

3 

1 

7 

39-40 

5 

1 

€ 

41-42 

2 

3 

1 

1 

8 

43-44 

1 

3 

5 

45-46 

1 

1 

47-48 

1 

1 

49-50 

1 

1 

2 
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DISTRIBUTION  OP  SCORES  FOR  AUDITORY  LETTER  SPAN 


Frequency  by  1 

treatment  condition 

Total 

Scores: 

bQ/H 

TQ/H 

NQ/H 

DQ/NH   TQ/NH  NQ/NH 

Frequency 

6 

1 

1 

1 

1 

1 

2 

1 

1             1 

5 

3 

6 

3 

1      4      1 

17 

-A 

J 

5 

5      2      4 

23 

5 

2 

9      7      7 

34 

6 

9 

8      7      7 

47 

7 

6 

5      1      6 

28 

8 

2 

4 

2      4      3 

16 

9 

1 

5 

10 

1      1 

4 

11 

1 

1 

1 

3 
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OBJECT  NUMBER,  PART  1 


Frequency  by  treatment  condition 

Total 

Scores: 

DQ/H 

TQ/H 

NQ/H 

DQ/NH 

TQ/NH 

NQ/NH 

Frequency 

1 

2 

3 

2 

1 

2 

4 

14 

4 

2 

24 

8 

2 

20 

2 

5 

16 

3 

2 

18 

4 

2 

26 

4 

4 

20 

1 

2 

2 

18 

2 

4 

10 

1 

1 

4 

11 

1 

2 

12 

4 

13 

1 

1 

2 

2 

7 

14 

1 

1 

1 

4 

15 

1 

1 

2 

4 
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INSERTED  QUESTIONS 


Frequency 

by  treatment  condition 

Total 

Scores : 

DQ/H   TQ/H 

NQ/H 

DQ/NH 

TQ/NH 

NQ/NH 

Frequency 

3    i 

1 

1 

1 

2     8 

6 

3 

19 

3     -i 

6 

5 

18 

IX           6 

2 

B 

21 

6     7 

12 

6 

31 

2     2 

5 

5 

14 

2     1 

1 

4 
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TREATMENT  TIME 


Frequenci 

by  treatment 

condi 

tion 

Total 

Scores : 

bQ/H 

TQ/H 

NQ/H 

DQ/NH 

TQ/NH 

NQ/NH 

Frequency 

44-45 

1 

1 

42-43 

40-41 

1 

1 

38-39 

1 

1 

2 

36-37 

1 

'  1 

34-35 

2 

3 

1 

8 

32-33 

3 

.1 

1 

8 

30-31 

1 

1 

1 

5 

28-29 

6 

3 

2 

14 

26-27 

5 

1 

8 

24-25 

5 

4 

4 

2 

20 

22-23 

3 

2 

2 

2 

1-6 

20-21 

2 

3 

4 

19 

18-19 

2 

3 

2 

3 

4 

19 

16-17 

3 

9 

4 

5 

25 

14-15 

3 

2 

2 

6 

16 

12-13 

2 

3 

4 

13 

10-11 

2 

3 

5 

8-  9 

3 

3 

6-  7 

4-  5 

2 

2 
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TEST  TIME 

Frequency 

by  treatment  condition  . 

Total 

Scores : 

DQ/H 

TQ/H 

NQ/H 

DQ/NH   TQ/NH 

NQ/NH 

Frequency 

S 

1 

1 

4 

5 

4 

3 

2      1 

11 

6 

4 

4 

1 

11 

7 

4 

4 

3 

2 

16 

8 

4 

5 

3 

3      6 

21 

9 

1 

3 

3 

9      6 

25 

10 

6 

6 

7 

6      7 

36 

11 

1 

1 

3 

3      1 

10 

12 

3 

1 

4 

3      1 

14 

13 

1 

6 

14 

1 

2 

8 

15 

2 

2 

9 

16 

2 

2 

17 

1 

1 

1 

5 

18 

1 

19 

1 

20 

1 

2 

21 

22 

1 

1 

23 

24 

25 

2 

2 

39 

1 

1 

40 

41 

1 

1 
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RELEVANT  DIAGRAM  QUESTIONS 


Frequency 

by  i 

treatment  condition 

Total 

Scores : 

DQ/H 

TQ/H 

nq/h 

DQ/NH 

TQ/NH 

NQ/NH 

Frequency 

4 

7 

^ 

2 

3 

5 

30 

3 

11 

7 

5 

4 

9 

39 

8 

7 

10 

7 

11 

6 

49 

6 

2 

3 

7 

7 

5 

30 

4 

2 

3 

7 

3 

3 

22 

2 

1 

4 

1 

4 

12 

2 

1 

3 
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INCIDENTAL  DIAGRAM  QUESTIONS 


Frequency 

^Y, 

treatment  condi 

tion 

Total 

Scores : 

DQ/H 

TQ/H 

nq/h 

DQ/NH 

TQ/NH 

nq/nh 

Frequency 

2 

2 

1 

2 

2 

11 

5 

5 

3 

1 

6 

25 

2 

3 

8 

2 

5 

27 

10 

10 

12 

2 

9 

5 

58 

6 

4 

8 

9 

9 

39 

2 

4 

8 

3 

3 

21 

2 

2 

3 

2 

9 

1 

1 

3 
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RELEVANT  TEXT  QUESTIONS 


Frequency  by 

treatment  condition 

Total 

Scores: 

DQ/H 

TQ/H 

NQ/H 

DQ/NH 

TQ/NH 

NQ/NH 

Frequency 

6 

8 

5 

14 

3 

6 

42 

1 

5 

8 

6 

4 

16 

47 

2 

9 

11 

8 

7 

6 

47 

3 

3 

5 

1 

10 

2 

27 

4 

1 

2 

2 

2 

11 

5 

2 

1 

1 

1 

6 

6 

1 

3 

4 
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IHCIDENTAL  TEXT  QUESTIONS 


Frequency  by  treatment  condition 

Total 

Scores : 

DQ/H 

TQ/H   NQ/H 

DQ/NH 

TQ/NH   NQ/NH 

Frequency 

4 

5     3 

1 

4       4 

21 

5 

6     6 

17 

7     10 

51 

6 

7     7 

3      7 

30 

9 

8     6 

6 

7      3 

39 

5 

2     3 

4 

4      7 

25 

2     6 

2 

4      1 

15 

1 

2 

1 

1 

2 
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OVER-ALL  POST-TEST  PERFORMANCE 


Frequency 

by  treatment  condition 

Total 

Scores: 

DQ/H 

TQ/H 

NQ/H 

DQ/NH 

TQ/NH 

NQ/NH 

Frequency 

6 

T 

1 

2 

1 

1 

1 

4 

2 

1 

1 

2 

1 

8 

3 

2 

3 

1 

7 

4 

1 

4 

2 

5 

14 

5 

2 

3 

3 

1 

2 

14 

6 

2 

1 

4 

1 

11 

7 

2 

3 

3 

1 

3 

13 

8 

2 

5 

6 

1 

15 

9 

4 

3 

2 

1 

20 

10 

1 

2 

4 

11 

2 

1 

4 

2 

14 

12 

2 

1 

1 

3 

9 

13 

5 

3 

2 

12 

14 

1 

1 

5 

3 

3 

14 

15 

1 

2 

2 

6 

16 

1 

2 

3 

17 

2 

2 

2 

6 

18 

1 

1 

1 

3 

6 

19 

1 

1 
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PERCENT  OF  INFORMATION  HIGHLIGHTED  IN  DIAGRAMS 


Scores 

T" 


2-  3 
4-  5 

6-  7 

8-  9 

10-11 

12-13 

14-15 

16-17 

18-19 

20-21 

22-23 

24-25 

26-27 

28-29 

30-31 

32-33 

34-35 

36-37 

38-39 

40-41 

42-43 

44-45 

46-47 

48-49 

50-51 

52-53 

69 

81 


Frequency  by  treatment  condition       Total 
DQTS  TQ/H  NQ/H  DQ/NH  TQ/NH  NQ/NH   Frequency 

5 ^ JI— 

5  8 


TT 
2 
5 

1 
2 


TT 
1 
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PERCENT  OF  INFORMATION  HIGHLIGHTED  IN  TEXT 


Frequency  by  treatment  condition      Total 
Scores:  DQTh  TQ/H  NQ/H  DQ/NH  TQ/nh  NQ/NH  Frequency 

2 
3 
3 
3 
4 
5 
7 
5 
6 
5 
8 
8 
4 
5 
8 
4 
4 
1 
2 
1 
2 


0-^3 

4-  7 

2 

8-11 

3 

12-15 

16-19 

1 

20-23 

2 

24-27 

4 

^8-11 

3 

32-35 

1 

36-39 

2 

40-43 

3 

44-47 

5 

48-51 

1 

52-55 

2 

56-59 

5 

60-63 

2 

64-65 

1 

70- 

77- 

84- 

89-91 

1 
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